ECS Tech Inc logo
ECS Tech Inc

All candidates must meet the following criteria: Must be a US Citizen, no dual Citizenships. Must be able to secure a Public trust clearance. Must be able to work across multiple programs across the Federal and DOD space. The core values that ECS looks for in an engagement manager include: Teamwork, Respect, Accountability, Integrity, and Leadership.

Senior Data Engineer

Location

United States

Posted

63 days ago

Salary

$165K - $180K / year

Seniority

Senior

Job Description

Senior Data Engineer

ECS Tech Inc

Role Description Everforth ECS is seeking a Senior Data Engineer to lead the design, development, and optimization of scalable enterprise data pipelines and cloud-native data services supporting the U.S. Consumer Product Safety Commission (CPSC). This role will help modernize and stabilize CPSC’s Azure-based data infrastructure while enabling advanced analytics, machine learning, and Sentinel-driven product safety initiatives. - Lead development of production-grade ETL workflows using Python and Microsoft-based technologies. - Design and optimize scalable ingestion, transformation, and validation pipelines for structured and unstructured datasets. - Implement schema enforcement, data validation, anomaly detection, and quality assurance frameworks. - Architect and manage Azure-based data solutions including Azure Data Lake Storage and Azure SQL. - Design and deploy orchestration workflows using Azure Data Factory and Microsoft Fabric/Foundry. - Develop Python-based data services leveraging libraries such as Pandas, PyTorch, TensorFlow, and related open-source frameworks. - Build APIs and microservices supporting interoperability with analytics and AI/ML platforms. - Implement monitoring, logging, fault tolerance, and performance optimization for large-scale systems. - Collaborate closely with data scientists, analysts, architects, and governance teams to deliver secure, reliable, and analytics-ready datasets. - Support Agile development processes and contribute to continuous improvement initiatives. Qualifications - 5+ years of experience developing and deploying advanced statistical, machine learning, or enterprise data pipeline solutions. - Strong proficiency in Python, including Pandas and related data engineering libraries. - Strong SQL skills and experience integrating relational database systems. - Hands-on experience designing and operating solutions in Azure cloud environments. - Experience developing ETL workflows using Python and Microsoft technologies. - Experience with schema enforcement, data validation, and quality assurance practices. - Experience developing APIs and cloud-native data services. - Familiarity with workflow orchestration tools such as Azure Data Factory. - Experience with performance optimization, logging, and monitoring for enterprise-scale systems. - Familiarity with open-source data processing and ML frameworks such as PyTorch, TensorFlow, NumPy, and scikit-learn. Requirements - Salary Range: $165,000-$180,000 Benefits - General Description of Benefits

Related Categories

Related Job Pages

More Data Engineer Jobs

Datavail logo

Data Engineer, Databricks

Datavail

We help clients turn data into decisions no matter where it lives-in apps, on-prem, in a hybrid model, or in the cloud.

Data Engineer63 days ago
Full TimeRemoteTeam 1,001-5,000Since 2007H1B Sponsor

• Lead and contribute to end-to-end Databricks implementations for clients, including data migration, Lakehouse architecture, and pipeline development • Gather technical requirements, design solutions, and present recommendations to client stakeholders (technical and business) • Build scalable ETL/ELT pipelines using PySpark, Delta Lake, Delta Live Tables (DLT), and Databricks Workflows • Design and implement Databricks Genie • Design and implement semantic layers • Use Databricks AI features to accelerate development, debugging, and code optimization • Design and implement Lakebase architectures for operational and analytical workloads, including transactional data use cases • Develop solutions using SDLC best practices, including modular code design, testing, and documentation • Use Git based version control with proper branching strategies • Implement CI/CD pipelines for Databricks asset • Implement data quality checks, validations, and expectations within workflows • Design and implement Unity Catalog governance, security, and lineage solutions • Optimize Databricks workloads for performance, cost, and reliability (Photon, cluster policies, Liquid Clustering, Auto Loader, etc.) • Integrate Databricks with client ecosystems (Azure, AWS, GCP, Snowflake, Kafka, legacy systems, etc.) • Support client workshops, proof-of-concepts (POCs), and knowledge transfer sessions • Deliver projects following consulting methodologies while meeting quality, timeline, and budget expectations • Document architectures, runbooks, and best practices for client use • Participate in solutioning activities (scoping, estimation, technical demos) as needed

United States
Job Closed
DAS42 logo

Data Engineer Consultant

DAS42

Faster Insights. Better Decisions.

Data Engineer63 days ago
Full TimeRemoteTeam 51-200Since 2013H1B No Sponsor

• Guide clients on optimizing their data environment to work most effectively and efficiently for them. Clarify management objectives through data solutions. • Develop system engineering, integrations, and architectures based on client needs. • Implement and provide advice on data warehouse solutions, ETL pipelines, and business intelligence reporting tools. • Develop a data model around stated use cases to capture client’s KPIs and data transformations. Validation and testing of data models. • Teach technical data modeling concepts to a variety of audiences, including developers, data architects, business users, and IT professionals. • Support, maintain, and document clients’ data environments. • Work within a project management framework to meet objectives, understand scope, and impact of your work across an organization. • Work with the Sales and Marketing teams to develop Thought Leadership and support our sellers by talking to clients about DAS42’s capabilities.

United States
$95K - $125K / year
Job Closed
Milliman logo

Data Engineer – Entry Level

Milliman

Solutions for a world at risk™

Data Engineer63 days ago
Full TimeRemoteTeam 1,001-5,000Since 1947H1B Sponsor

• Build Pipelines: Design and maintain scalable data pipelines to ingest and enrich healthcare data using Databricks and Spark. • Optimize Data Workflows: Improve data intake processes and optimize SparkSQL/Python workloads for performance, scalability, and cost efficiency. • Design Data Models: Partner with senior engineers to develop data marts and semantic models that power analytics products and reporting. • Ensure Quality: Monitor pipeline health, troubleshoot failures, and implement data validation and quality controls. • Learn & Grow: Expand your knowledge of the full data lifecycle, cloud infrastructure (Azure/AWS), and healthcare data standards.

Arizona + 19 moreAll locations: Arizona | California | Connecticut | Florida | Idaho | Illinois | Maine | New Jersey | New York | Oregon | Maryland | Massachusetts | Missouri | Pennsylvania | Texas | Utah | Vermont | Virginia | Washington | Wisconsin
$71.7K - $131.9K / year
Job Closed

Lead Data Engineer – Platform

Valtech

A pioneer in the fields of digital and technology, Valtech is a global business-transformation agency that was founded in 1993 to deliver "innovation with a pur

Data Engineer63 days ago

• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption

Poland
Job Closed