Engineering Innovation and Transformation
Senior Data Engineer – Databricks, AWS
Location
Maryland
Posted
6 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer – Databricks, AWS
Booker DiMaio
• Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services. • Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing. • Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads. • Develop and support medallion architecture data pipelines and enterprise data quality frameworks. • Implement data governance controls, metadata management, lineage tracking, and data retention policies. • Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions. • Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques. • Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities. • Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts. • Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards.
Job Requirements
- Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline.
- Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture.
- Minimum three (3) years of hands-on Databricks experience in production environments.
- Experience designing, developing, and supporting large-scale ETL/ELT solutions.
- Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch.
- Experience implementing enterprise data governance and security controls.
- Strong SQL and Python development skills.
- Experience working with data lakes, data warehouses, and cloud-native analytics platforms.
- Strong troubleshooting, performance tuning, and optimization experience.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
SuperStaffComprehensive BPO, RPO, and Call Center Outsourcing Solutions for Growing Businesses
• Data Ingestion & ETL: Build Python/SQL pipelines to ingest invoices, orders, and catalogs. • Perform historical backfills via SFTP/API and manage Airflow DAGs. • Instance Configuration: Set up custom fields, product filtering logic, and sales workflows. • Manage SSO and user provisioning for new rollouts. • AI-Augmented Engineering: Leverage AI coding assistants (Copilot, Cursor) and LLMs to accelerate Python/SQL script generation, data mapping, and debugging. • Customer Communication & Projects: Act as a technical point of contact. Translate complex data issues into clear updates for customers. Own project milestones from kickoff to "Go Live." • Integration & Automation: Build Workato recipes and connect customer ERPs via APIs/webhooks to ensure real-time data flow. • QA & Troubleshooting: Triage HubSpot support tickets, debug data discrepancies in large data sets, and deploy production fixes. • Documentation: Maintain customer data mappings and internal technical runbooks.
• Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone • Design and build unified batch and streaming pipelines that handle high-volume, mission-critical workloads • Lead infrastructure-as-code practices, ensuring environments are repeatable, secure, and version-controlled • Implement open table formats to enable cross-cloud and cross-engine data interoperability • Establish automated data quality, metadata, and lineage practices across the data estate • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products • Mentor engineers, review designs, and raise the bar on engineering standards
Data Engineer
ICFFounded in 1969, ICF is a global advisory and technology services company headquartered in Reston, Virginia. It delivers data-driven solutions across energy, en
• This role supports the large-scale modernization of legacy systems by leading the migration of over 10TB of documentation and records into a cloud-based environment. • The position focuses on transforming document-heavy workflows into structured, digital processes, while enabling seamless data integration across systems using MuleSoft APIs. • The work directly supports enhanced analytics, reporting, and operational efficiency for a mission-critical enterprise platform. • Lead end-to-end data migration from legacy systems to cloud platforms, including data mapping, transformation, and validation (Salesforce-centric). • Analyze and convert unstructured, document-heavy data into structured, analytics-ready formats using Document AI. • Implement data quality processes (cleansing, deduplication, reconciliation) to ensure accuracy and completeness post-migration. • Support phased migration and system cutover with minimal operational disruption. • Design, build, and maintain MuleSoft integrations, including API development for real-time and batch data exchange. • Apply data transformation logic (e.g., DataWeave) and troubleshoot integration/data flow issues across systems. • Contribute to Salesforce Data 360 implementation, including data harmonization, identity resolution, and unified profiles. • Ensure proper data ingestion, lineage, metadata management, and traceability across the ecosystem. • Ensure compliance with data governance, privacy, and security requirements (e.g., PII). • Collaborate in Agile teams; support testing, documentation, and audit readiness across migration and integration efforts.
Data Entry 1 - 210025
TEKsystemsWe're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.
Role Description Position Purpose: Accurately enter and process member provider selection requests and all other administrative operational tasks. - Track and process various change requests forms and doctor selection requests received through the member portal and other system queues timely and accurately. - Process provider termination requests by performing membership moves and initiate termination letter requests to affected membership. - Manually process provider selections for members unable to assign through the health plans auto-assignment systematic process. - Track and report provider selection errors demonstrated by call center representatives. - Retrieve and process all incoming returned mail and fax requests. - Process all provider member dis-enrollment requests. Qualifications - High school diploma or equivalent. - 1 year of data entry or general office experience. - Health plan experience. - Data entry experience. - Previous experience with computer applications, such as Microsoft Word and Excel. - Health Net system experience (ABS, NDS, Macess, Portico, etc). - Centene previous experience. Requirements - Typing test, basic computer skills test. - Years of experience required: + years related experience. - Manager wants the healthcare related positions to be recent. Benefits - Medical, dental & vision. - Critical Illness, Accident, and Hospital. - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available. - Life Insurance (Voluntary Life & AD&D for the employee and dependents). - Short and long-term disability. - Health Spending Account (HSA). - Transportation benefits. - Employee Assistance Program. - Time Off/Leave (PTO, Vacation or Sick Leave). Company Description This is a Contract position based out of Los Angeles, CA. The pay range for this position is $23.00 - $23.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: This is a fully remote position. This position is anticipated to close on Jun 17, 2026.



