Job Closed

This listing is no longer active.

ConsumerAffairs logo
ConsumerAffairs

Make big purchases no big deal

AI Native, Data Engineer

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 201-500Since 2007H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

59 days ago

Salary

0

Seniority

Mid Level

Job Description

AI Native, Data Engineer

ConsumerAffairs

The Data Engineer is responsible for monitoring, expanding, and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems as well as building them from the ground up. The Data Engineer supports our solution architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. Candidates should have education and/or experience in data modeling, requirements analysis, and best practices in analytics. Experience with BI applications is a definite plus. - Develop, test, and maintain data pipelines to support data integration and processing. - Assist in the design and implementation of data models and data warehousing solutions. - Collaborate with data scientists and analysts to understand data requirements and ensure data is accessible and reliable. - Monitor data pipelines and systems, troubleshooting issues as they arise. - Work with senior data engineers to optimize data processes and infrastructure. - Ensure data quality and integrity through regular audits and validations. - Contribute to the documentation of data processes and best practices

Job Requirements

  • Education/Licensure/Certification:
  • BSc/BA in Computer Science, Engineering or relevant field
  • Experience:
  • 2-4 years of experience in data engineering or a related field.
  • 2-4 years’ experience in Data Integration and Integration
  • 2- 4  years’ experience in Data Warehousing, notably Cloud Data
  • Proficiency in SQL and Python
  • Familiarity with cloud platforms (AWS, GCP) and data warehousing solutions.
  • Understanding of ETL processes and data integration techniques.
  • Knowledge, skills and abilities:
  • Fluent in English
  • Nice to have: experience with ETL tools like Stitch, Fivetran, and Snowfire
  • Must be highly curious, driven, and disciplined
  • Understanding of data models, data warehouses, and data mining
  • Familiarity with BI technologies
  • Knowledge of SQL is required
  • Familiarity with cloud analytics is beneficial (AWS, Snowflake)
  • Proven abilities to take initiative and be innovative
  • Analytical mind with a problem-solving aptitude
  • Stands up for decisions and takes responsibility for results
  • Shares both good and bad outcomes transparently
  • Obsessed with ensuring an exceptional customer experience- for both internal and external customers.
  • Stands up for decisions, takes responsibility for results, and shares both good and bad outcomes transparently.
  • Demonstrates a relentless focus on results with a commitment to deliver;
  • Takes decisive action, and confidently changes course if unsuccessful.
  • Displays a growth mindset to continually improve; encourages everyone around them to be tenacious and never settle.
  • Constantly seeks feedback to improve; Focuses on solving issues through teamwork, and collaboration
  • Acts with urgency; delivers top results in hours and days instead of weeks and months.
  • Relentless in their pursuit of success and possessing the willpower to embrace challenges as opportunities

Benefits

  • Why You’ll Love Working Here
  • At ConsumerAffairs, your voice matters. We foster a collaborative environment where you’re encouraged to take initiative, experiment boldly, and grow professionally. We're committed to work-life harmony, career development, and celebrating wins together.
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development

Related Categories

Related Job Pages

More Data Engineer Jobs

Superside logo

Staff AI/Data Engineer

Superside

Founded in 2015, Superside is an "always-on" design company on a mission to deliver beautiful design at scale to enterprise teams. From everyday production proj

Data Engineer59 days ago

• Build the knowledge layer that sits underneath Superads' AI agents — the systems that give them genuine understanding of a brand rather than just access to its documents. • Design how brand knowledge is represented, stored, and continuously updated: the structures that let an agent reason about a brand the way a senior strategist would, not just retrieve what's been written down. • Develop agentic search capabilities — systems that let agents reason about what they don't know, identify knowledge gaps, and navigate information dynamically rather than relying on fixed retrieval pipelines. • Evaluate and iterate on architectures for knowledge retrieval and reasoning, identifying where current approaches break down and driving more interesting solutions. • Translate emerging AI research and patterns into production-ready systems that measurably improve output quality and reliability. • Work closely with the product and AI engineering teams to ensure the knowledge layer directly improves what users experience — staying connected to product impact even when the work takes you deep into infrastructure.

Spain

Senior Data Engineer

The Hologram Company

Artist Development and Consulting @thehologramco

Data Engineer59 days ago
Full TimeRemoteTeam 1-10H1B No Sponsor

• Database Design & Management: Design, build, and maintain databases that power Hologram's operations, with a focus on simplicity, reliability, and scalability • Pipeline Development: Build and maintain ETL pipelines that move and transform data reliably, with monitoring and alerts to catch breakages fast • Database Reconstruction & Simplification: Audit existing pipelines and data models, identify complexity, and refactor bad decisions into clean, maintainable solutions — incrementally improving what exists rather than starting from scratch. • Data Modeling & Transformation: Own and evolve our dbt models, ensuring data is clean, well-documented, and usable by people outside of engineering • Analytics & Reporting: Write expert SQL to surface insights across the business — from customer usage trends to operational performance • Business Intelligence: Build and maintain dashboards and reports in Sigma that give internal teams clear visibility into the metrics that matter

United States
$180K - $220K / year
Job Closed
Spyrosoft logo

Data Engineer – LIMS/ELN

Spyrosoft

We enable our clients to thrive, thanks to a combination of technical proficiency and domain-specific knowledge.

Data Engineer59 days ago
Full TimeRemoteTeam 1,001-5,000Since 2016H1B No Sponsor

• Work with laboratory data sources such as LIMS, ELN, Excel, and SharePoint • Design and build data pipelines using Python and SQL • Transform and structure messy R&D data into clean, well-organized datasets • Process and manage data using Azure and Databricks • Collaborate with cross-functional teams, including scientists and analysts • Ensure data quality, consistency, and usability across systems

Poland
zł130 - zł150 / hour
Full TimeRemoteTeam 51-200

About Dimagi Dimagi is an award-winning social enterprise and a certified B-corp and Benefit Corporation. We build software solutions and provide technology consulting services to improve the quality of essential services for underserved populations. Our open-source technology platform, CommCare, is the world’s most widely-used and researched mobile data collection platform for frontline workers. Our choice to be a certified B-Corp and to legally incorporate as a Benefit Corporation sends a clear signal to our partners, our team members, and our communities that we not only believe but also take action in using business as a force for good. This approach combines our passion and commitment to tackle complex health and social inequities and work towards a brighter future for all. About the Position Dimagi is looking for a Data Engineer II to join our US Solutions Division. This position will be affiliated with our Cambridge, MA office but is open to remote employment within the United States. This is a 12-month fixed-term position with the possibility of renewal based on business requirements and mutual interest. The Data Engineer II will be part of Dimagi’s US Solutions Division Data & Analytics team, a group of engineers and data specialists responsible for building, maintaining, and evolving Dimagi’s Data Platform in support of current and future project work. The primary technologies used by the current data platform are Snowflake, Tableau, and various AWS cloud tools. In this role, you will contribute hands-on to the design, implementation, and operation of data pipelines, warehouse transformations, data visualizations, and supporting infrastructure, while working closely with technical leadership to ensure platform reliability, scalability, and alignment with business needs. The data systems you help build and maintain will directly support public health and human services programs, enabling frontline teams and government partners to deliver care and services more effectively. This position is well suited for someone who enjoys hands-on technical work in a small, collaborative environment. As a member of a lean team, you will be expected to work across functional areas, adapt quickly to new problem spaces, and contribute meaningfully to data systems that support real-world service delivery and decision-making. This role assumes comfort using AI-assisted tools to support analysis, documentation, troubleshooting, and learning in a complex technical environment. Responsibilities - Contribute to the technical integrity and evolution of the Data Platform tech stack, working closely with other Data Engineers, the Director of Technology, and the USS Tech Lead. - Design and implement core features and enhancements within the Data Platform, including contributing to technical specifications, conducting targeted technical research, and translating requirements into production-ready solutions. - Responsible for executing and maintaining DevOps workflows supporting the Data Platform, including performance monitoring, platform upgrades, deployment frameworks, and operational improvements, with guidance and mentorship from more senior Data Engineers as needed. - Use AI-assisted tools thoughtfully to accelerate development, debugging, documentation, and operational analysis, while understanding and validating outputs to ensure correctness, reliability, and security. - Build and maintain robust data extraction, loading, and transformation processes for both Dimagi managed (i.e. CommCare) and external data sources, enabling efficient, reliable data pipelines and their long-term development and operation using both SQL and Python scripting. - Design and develop data warehouse transformations, using SQL-based approaches and supplementary tools such as dbt. - Collaborate with internal teams and external partners on the design and implementation of enterprise data architectures based on industry standards and partner specific analytics needs. - Conduct ad hoc analyses and support the development of business intelligence outputs, including dashboards and visualizations using Tableau and other tools. The ideal candidate will have some or all of the following experience: - 2–5 years of experience in data engineering or a similar technical role, with a proven track record of designing and evolving scalable data systems. - Experience building maintainable, long-term technical solutions using software development best practices (version control, testing, and iterative development). - Hands-on expertise in building and managing production-grade pipelines using ETL/ELT tools (e.g., dbt, Airflow, Prefect, Fivetran, or Talend). - Strong proficiency with cloud-based data platforms (AWS, Snowflake, etc.) and a diverse range of data ingestion, processing, and storage technologies. - Expert-level SQL for complex data engineering and analysis, paired with proficiency in Python and associated data-oriented toolkits. - A deep understanding of dimensional modeling concepts ((e.g. OLAP cubes, star schemas, kimball architecture vs. alternatives like inmon) - Proven ability to partner with technical stakeholders to clarify requirements and deliver effective, end-to-end data solutions. - Proficiency in using AI-assisted tools for code generation, debugging, and optimization, with the ability to rapidly adapt to new schemas and tools in a fast-paced environment. - Comfortable working "in the trenches" of production systems to test, iterate, and optimize operational workflows. - Eligible to work in the United States Bonus Experience - Experience in enterprise data architecture, service-oriented frameworks, data integration and harmonization, data strategy and governance, high-performing data lakes, data operations and delivery and data ingestion frameworks supporting batch/real-time - Experience writing and maintaining production ready code in a high level programming language (Python, Java, C++ etc.) - Experience with data analysis software (Jupyter Notebooks, R, etc.) and data visualization tools (Tableau, Power BI, Superset, etc.). - Healthcare experience: either in healthcare data or public health data collection methodologies and workflows - Experience and comfort working independently with partners for requirements gathering and solution development in an agile software development environment, using JIRA and Asana to manage tasks between technical and client-facing teams Benefits and Compensation We aim to make a difference, not just as a company but also as an employer! We are transparent about salaries at all levels of the organization and have a standard, global pay scale for all positions. Our salaries are cost of living adjusted and non-negotiable. The estimated salary range for this position is 82,810 USD - 130,319 USD annually. Your final salary within the range will be dependent on where you are geographically based and might fall outside of this estimated range. However, the benefits we offer are geared towards having a strong impact on our staff’s well-being. A few of our key benefits are outlined below: - 100% employer-sponsored medical insurance paired with a generous Health Reimbursement Account (HRA) fund - Access to voluntary dental and vision insurance plans - A 401K plan with up to a 4% employer match - Employee stock option plan - 30 days paid time off inclusive of holidays - Unlimited sick time and excellent parental leave policy - Access to a flex-time policy that allows employees to work based on a flexible work schedule - Access to an Employee Assistance Program (EAP) through ComPsych Dimagi is an Equal Opportunity Employer. We celebrate and support diversity and are committed to providing a work environment that is inclusive and free of discrimination and harassment. All employment decisions are based on individual qualifications without regard to race, color, religion, age, sex, sexual orientation, ethnicity, gender identity and expression, national origin, family or parental status, veteran or disability status.

United States
$82.8K - $130K / year
Job Closed