Data-driven consulting and technology services
Data Engineer, Data Quality & Automation
Location
United States
Posted
21 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer, Data Quality & Automation
Analytica
• Design, develop, and maintain ETL/ELT data pipelines supporting enterprise data platforms. • Implement and enhance data ingestion, transformation, and integration processes using SQL and modern programming languages. • Design and implement automated data quality and validation checks (e.g., schema integrity, completeness, freshness, volume). • Embed data validation and testing logic directly into data pipelines and CI/CD workflows. • Refactor and modernize existing data pipelines to improve reliability, performance, and maintainability. • Collaborate with technical leads, architects, and engineering teams to define and promote standard data engineering and quality practices. • Support deployment, monitoring, and troubleshooting of data pipelines across development, test, and production environments. • Contribute to technical documentation, runbooks, and reusable components to improve team efficiency and consistency. • Participate in design and code reviews with a focus on sustainability, automation, and operational excellence.
Job Requirements
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent experience.
- 5+ years of experience in data engineering, ETL development, or related roles.
- Strong experience with Microsoft SQL Server and enterprise data warehouse or data lake platforms.
- Proficiency in Python or similar scripting languages for automation.
- Hands-on experience building and supporting ETL/ELT pipelines.
- Experience implementing automated data validation or data quality checks within data pipelines.
- Familiarity with CI/CD concepts and tools as applied to data engineering workflows.
- Strong analytical and problem-solving skills.
- Excellent written and verbal communication skills.
- Must be a U.S. Citizen with the ability to obtain a secret clearance.
Benefits
- bonuses
- employer-paid health care
- training and development funds
- 401(k) match
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, build, and maintain scalable data pipelines and APIs on Google Cloud Platform • Develop automated workflows and data platforms that support analytics, reporting, and AI/ML use cases • Implement best practices for data security, governance, CI/CD, and automated deployment • Collaborate with data engineers, architects, data scientists, and business stakeholders • Produce high-quality, reusable code and mentor team members on best practices • Support testing, deployment, monitoring, and production troubleshooting
Senior Data Engineer
Hunt StWe help Aussie companies find top 3% remote talent in the Philippines & Nepal for a single finder's fee.
• Design, build, and maintain scalable data pipelines in modern lakehouse architectures. • Develop clean, efficient, and production-ready Python and SQL code. • Implement ETL/ELT processes, transformations, and orchestration workflows. • Model data using medallion architecture (Bronze/Silver/Gold), star schemas, and SCDs. • Integrate multiple data sources (APIs, databases, SaaS platforms, flat files). • Deploy pipelines using CI/CD tools and version control best practices. • Leverage AI tools (e.g., agent-based workflows, automation scripts) to improve delivery speed and quality. • Collaborate directly with clients on requirements, architecture, and delivery updates. • Monitor, troubleshoot, and optimise pipelines for performance and reliability. • Ensure data quality, integrity, and production readiness.
Senior Data Engineer
Hunt StWe help Aussie companies find top 3% remote talent in the Philippines & Nepal for a single finder's fee.
Role Description We’re looking for a Senior Data Engineer to join a high-performing delivery team and work on end-to-end data solutions across modern lakehouse environments. This is a hands-on role, focused on building and shipping production pipelines—not people management. You’ll work directly with clients and senior engineers, owning delivery from ingestion through to transformation and consumption. - Design, build, and maintain scalable data pipelines in modern lakehouse architectures. - Develop clean, efficient, and production-ready Python and SQL code. - Implement ETL/ELT processes, transformations, and orchestration workflows. - Model data using medallion architecture (Bronze/Silver/Gold), star schemas, and SCDs. - Integrate multiple data sources (APIs, databases, SaaS platforms, flat files). - Deploy pipelines using CI/CD tools and version control best practices. - Leverage AI tools (e.g., agent-based workflows, automation scripts) to improve delivery speed and quality. - Collaborate directly with clients on requirements, architecture, and delivery updates. - Monitor, troubleshoot, and optimise pipelines for performance and reliability. - Ensure data quality, integrity, and production readiness. Qualifications - 5+ years of professional experience in data engineering. - Must have experience with Databricks or Fabric. - Strong Python skills for production environments. - Advanced SQL (CTEs, window functions, performance tuning, complex joins). - Hands-on experience with modern data platforms (lakehouse, pipelines, distributed processing). - Experience with dimensional modelling and analytics-ready data design. - Solid understanding of CI/CD, Git workflows, and deployment practices. - Strong communication skills with the ability to work directly with clients. - Ability to translate business requirements into technical solutions. - AI Proficiency (Required) Requirements - This role requires strong, practical experience using AI in development workflows: - Comfortable working in modern development environments with AI-assisted tooling. - Proven experience building AI-powered tools, automations, or agents with real business impact. - Ability to use AI across the development lifecycle (design, coding, debugging, testing, documentation). - Strong judgment in validating and refining AI-generated outputs. - Experience with prompt design, context handling, and tool integrations. Nice to Have - Experience with integration platforms or middleware tools. - Exposure to dbt or modern data transformation frameworks. - Experience with cloud-based data ecosystems. - Dashboarding or semantic modelling experience. - Familiarity with AI/agent frameworks or orchestration tools. - Previous consulting or client-facing project delivery. Work Arrangement & Expectations This is a remote role that will be set up as an employer of record. To ensure alignment and transparency, successful candidates will be expected to: - Disclose any existing ongoing roles or client work. - Reflect this engagement on their LinkedIn profile.
Enterprise Data Architect
AAAProud to serve our 62+ million members, help travelers see the world and drive real change to improve road safety.
• CSAA Insurance Group is seeking a Principal Architect to serve as our Enterprise Data Architect • Supporting the design and delivery of secure, scalable data and AI platforms across the enterprise • Facilitating designs and building solutions across the enterprise • Solutions are built in a highly collaborative environment, partnering with engineering, product, and program leaders • Leads and provides direction to Application Integration, Data, and Platform architecture vision for the enterprise • Integrates a broad range of ideas regarding technical and solution architecture • Creates, guides, and partners with other architects in creating and maintaining roadmaps that connect business strategies to capabilities • Enables AI/ML use cases by supporting data pipelines, feature engineering, and model integration • Balances speed and control to support business innovation



