Human-centered innovation partner, crafting impactful user experiences for government and commercial sectors
Data Engineer
Location
United States
Posted
24 days ago
Salary
$135K - $155K / year
Seniority
Senior
Job Description
Data Engineer
Element
• Build and maintain high-volume, scalable data pipelines using Apache Kafka and Apache Spark, supporting both real-time and batch data processing needs. • Design, develop, and optimize data ingestion, transformation, and integration workflows across enterprise systems. • Ensure data quality, consistency, and integrity across four (4) disparate data sources, implementing validation, cleansing, and reconciliation processes. • Develop and maintain SQL-based data solutions, including complex queries, stored procedures, performance tuning, and data modeling. • Collaborate with data analysts, product owners, and application teams to define data requirements and ensure alignment with business needs. • Implement monitoring, logging, and alerting mechanisms to ensure reliability and observability of data pipelines. • Support data architecture design and contribute to best practices for scalable and secure data engineering solutions. • Ensure compliance with federal data governance, security, and privacy requirements. • Participate in Agile ceremonies and support iterative development and delivery of data capabilities. • Troubleshoot and resolve data pipeline issues, ensuring minimal disruption to downstream systems and reporting.
Job Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or related field (or equivalent experience).
- 3+ years of experience in data engineering, data integration, or related technical roles.
- Strong hands-on experience with Apache Kafka for streaming data pipelines.
- Strong experience with Apache Spark for large-scale data processing (batch and/or streaming).
- Advanced SQL development experience, including complex queries, performance tuning, and data transformation logic.
- Experience integrating and managing data across multiple heterogeneous data sources.
- Experience working in the federal government or other highly regulated environments with security and compliance requirements.
- Strong understanding of data quality management, data validation, and data governance practices.
- Strong problem-solving and analytical thinking abilities.
- Excellent communication skills, with the ability to explain technical concepts to non-technical stakeholders.
- Strong attention to detail, especially in ensuring data accuracy and consistency.
- Ability to work independently in a fast-paced, mission-driven environment.
- Strong collaboration skills across cross-functional technical and business teams.
- US Citizenship or Permanent Residency required.
- Must reside in the Continental US.
- Depending on the government agency, specific requirements may include public trust background check or security clearance.
Benefits
- health care
- dental
- vision
- life insurance
- 401(k)
- paid time off including PTO, holidays, and any other paid leave required by law
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, build, and maintain scalable data pipelines and APIs on Google Cloud Platform. • Develop automated workflows and data platforms that support analytics, reporting, and AI/ML use cases. • Implement best practices for data security, governance, CI/CD, and automated deployment. • Collaborate with data engineers, architects, data scientists, and business stakeholders. • Produce high-quality, reusable code and mentor team members on best practices. • Support testing, deployment, monitoring, and production troubleshooting.
• Design, build, and maintain scalable data pipelines and APIs on Google Cloud Platform • Develop automated workflows and data platforms that support analytics, reporting, and AI/ML use cases • Implement best practices for data security, governance, CI/CD, and automated deployment • Collaborate with data engineers, architects, data scientists, and business stakeholders • Produce high-quality, reusable code and mentor team members on best practices • Support testing, deployment, monitoring, and production troubleshooting
• Design, build, and maintain scalable data pipelines and APIs on Google Cloud Platform • Develop automated workflows and data platforms that support analytics, reporting, and AI/ML use cases • Implement best practices for data security, governance, CI/CD, and automated deployment • Collaborate with data engineers, architects, data scientists, and business stakeholders • Produce high-quality, reusable code and mentor team members on best practices • Support testing, deployment, monitoring, and production troubleshooting
Staff Engineer – Data Engineering
ChartbeatChartbeat is a privately-held technology startup whose content intelligence platform offers publishers tools to build audiences across multiple digital formats. Launched in 2009, t
• Design, own and contribute to the cross-division data architecture, establishing patterns and standards that scale across both Chartbeat and Tubular platforms • Lead the technical strategy for integrating data products across divisions, enabling new cross-brand features and insights • Drive the AI and backend infrastructure roadmap - from data pipelines that feed models to deployment patterns for LLM-powered features • Identify and close skill gaps across the data engineering team, actively mentoring engineers and elevating the collective technical ceiling • Collaborate with product, engineering, and ML teams to translate business needs into scalable architectural decisions • Establish and evolve best practices for data modeling, pipeline design, and system observability across the organization • Evaluate and prototype emerging AI and generative AI technologies for application to real-world product challenges • Participate in engineering planning and contribute to roadmap prioritization with a cross-division perspective • Be part of engineering on call rotation to monitor and maintain the health of our production systems.
