All candidates must meet the following criteria: Must be a US Citizen, no dual Citizenships. Must be able to secure a Public trust clearance. Must be able to work across multiple programs across the Federal and DOD space. The core values that ECS looks for in an engagement manager include: Teamwork, Respect, Accountability, Integrity, and Leadership.
Senior Data Engineer
Location
United States
Posted
63 days ago
Salary
$165K - $180K / year
Seniority
Senior
Job Description
Senior Data Engineer
ECS Tech Inc
Role Description Everforth ECS is seeking a Senior Data Engineer to lead the design, development, and optimization of scalable enterprise data pipelines and cloud-native data services supporting the U.S. Consumer Product Safety Commission (CPSC). This role will help modernize and stabilize CPSC’s Azure-based data infrastructure while enabling advanced analytics, machine learning, and Sentinel-driven product safety initiatives. - Lead development of production-grade ETL workflows using Python and Microsoft-based technologies. - Design and optimize scalable ingestion, transformation, and validation pipelines for structured and unstructured datasets. - Implement schema enforcement, data validation, anomaly detection, and quality assurance frameworks. - Architect and manage Azure-based data solutions including Azure Data Lake Storage and Azure SQL. - Design and deploy orchestration workflows using Azure Data Factory and Microsoft Fabric/Foundry. - Develop Python-based data services leveraging libraries such as Pandas, PyTorch, TensorFlow, and related open-source frameworks. - Build APIs and microservices supporting interoperability with analytics and AI/ML platforms. - Implement monitoring, logging, fault tolerance, and performance optimization for large-scale systems. - Collaborate closely with data scientists, analysts, architects, and governance teams to deliver secure, reliable, and analytics-ready datasets. - Support Agile development processes and contribute to continuous improvement initiatives. Qualifications - 5+ years of experience developing and deploying advanced statistical, machine learning, or enterprise data pipeline solutions. - Strong proficiency in Python, including Pandas and related data engineering libraries. - Strong SQL skills and experience integrating relational database systems. - Hands-on experience designing and operating solutions in Azure cloud environments. - Experience developing ETL workflows using Python and Microsoft technologies. - Experience with schema enforcement, data validation, and quality assurance practices. - Experience developing APIs and cloud-native data services. - Familiarity with workflow orchestration tools such as Azure Data Factory. - Experience with performance optimization, logging, and monitoring for enterprise-scale systems. - Familiarity with open-source data processing and ML frameworks such as PyTorch, TensorFlow, NumPy, and scikit-learn. Requirements - Salary Range: $165,000-$180,000 Benefits - General Description of Benefits
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer, Databricks
DatavailWe help clients turn data into decisions no matter where it lives-in apps, on-prem, in a hybrid model, or in the cloud.
• Lead and contribute to end-to-end Databricks implementations for clients, including data migration, Lakehouse architecture, and pipeline development • Gather technical requirements, design solutions, and present recommendations to client stakeholders (technical and business) • Build scalable ETL/ELT pipelines using PySpark, Delta Lake, Delta Live Tables (DLT), and Databricks Workflows • Design and implement Databricks Genie • Design and implement semantic layers • Use Databricks AI features to accelerate development, debugging, and code optimization • Design and implement Lakebase architectures for operational and analytical workloads, including transactional data use cases • Develop solutions using SDLC best practices, including modular code design, testing, and documentation • Use Git based version control with proper branching strategies • Implement CI/CD pipelines for Databricks asset • Implement data quality checks, validations, and expectations within workflows • Design and implement Unity Catalog governance, security, and lineage solutions • Optimize Databricks workloads for performance, cost, and reliability (Photon, cluster policies, Liquid Clustering, Auto Loader, etc.) • Integrate Databricks with client ecosystems (Azure, AWS, GCP, Snowflake, Kafka, legacy systems, etc.) • Support client workshops, proof-of-concepts (POCs), and knowledge transfer sessions • Deliver projects following consulting methodologies while meeting quality, timeline, and budget expectations • Document architectures, runbooks, and best practices for client use • Participate in solutioning activities (scoping, estimation, technical demos) as needed
• Guide clients on optimizing their data environment to work most effectively and efficiently for them. Clarify management objectives through data solutions. • Develop system engineering, integrations, and architectures based on client needs. • Implement and provide advice on data warehouse solutions, ETL pipelines, and business intelligence reporting tools. • Develop a data model around stated use cases to capture client’s KPIs and data transformations. Validation and testing of data models. • Teach technical data modeling concepts to a variety of audiences, including developers, data architects, business users, and IT professionals. • Support, maintain, and document clients’ data environments. • Work within a project management framework to meet objectives, understand scope, and impact of your work across an organization. • Work with the Sales and Marketing teams to develop Thought Leadership and support our sellers by talking to clients about DAS42’s capabilities.
• Build Pipelines: Design and maintain scalable data pipelines to ingest and enrich healthcare data using Databricks and Spark. • Optimize Data Workflows: Improve data intake processes and optimize SparkSQL/Python workloads for performance, scalability, and cost efficiency. • Design Data Models: Partner with senior engineers to develop data marts and semantic models that power analytics products and reporting. • Ensure Quality: Monitor pipeline health, troubleshoot failures, and implement data validation and quality controls. • Learn & Grow: Expand your knowledge of the full data lifecycle, cloud infrastructure (Azure/AWS), and healthcare data standards.
Lead Data Engineer – Platform
ValtechA pioneer in the fields of digital and technology, Valtech is a global business-transformation agency that was founded in 1993 to deliver "innovation with a pur
• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption



