Job Closed

This listing is no longer active.

Afresh Technologies logo
Afresh Technologies

Afresh Technologies is a software development company that has built an artificial intelligence (AI)-powered operating system specifically designed for grocery retailers. The compa

Senior Data Engineer

Location

Michigan + 1 moreAll locations: Michigan | Canada

Posted

108 days ago

Salary

$0

Seniority

Senior

Bachelor Degree9 yrs expEnglishDatabricksdbtPySparkPythonSnowflakeSQL

Job Description

Senior Data Engineer

Afresh Technologies

Afresh is the leading AI company in fresh food—partnering with grocers like Albertsons, Wakefern, Meijer, and Stater Bros to order billions of dollars of fresh food in over 12,000 grocery departments nationwide. Following record-breaking 70% growth in 2025, we’ve expanded our platform to cover all fresh departments, launched our full store suite, and debuted DC Fresh Buying. We’re on a mission to eliminate food waste and make fresh food accessible to all. In 2025 alone our software helped save 200M lbs of food waste. If you're looking for a role where your work directly translates into massive scale and social good, and you want to be part of the team that defines the future of fresh, there is no better time to join us. About the Role As a Senior Data Engineer, you’ll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs that reliably process large volumes of customer-provided data and build tools/improve the platform to make customer integrations faster, more accurate, and more scalable. You’ll also contribute to the development of new features that support our expanding product lines. Your work will have a direct and visible impact on our ability to onboard customers more easily and quickly and power our machine learning grocery solution. What You’ll Do Build tools and frameworks that streamline customer integrations, enabling faster onboarding and better handling of customer data. Create robust ETLs in PySpark and DBT to process billions of records from customer datasets, ensuring data is accurate, reliable, and ready for downstream use. Investigate and implement new technologies into the data platform, focusing on practical solutions that address current pain points and anticipate future needs. Collaborate with product, engineering, and go-to-market teams to design and deliver data solutions for new products and features. Identify and implement optimizations to improve ETL runtime and data processing scalability, reducing the time and effort required for integrations. Solve real-world data quality challenges by working directly with messy, incomplete, or inconsistent customer data to extract the signal we need. Support team members by mentoring engineers, leading technical discussions, and providing clear, actionable feedback. What Makes You a Great Fit We encourage all highly-qualified candidates to apply, even if they don’t meet every listed qualification. Salary Range in U.S.: $156,000 - $211,000 Salary Range in Canada (CAD): $137,000 - $185,000 About Afresh Founded in 2017, Afresh is working on the #1 solution to curb climate change: reducing food waste. By combining human insight and transformative technology, we're helping grocers provide fresher food to customers at more affordable prices. Afresh sits at an incredible intersection of positive social impact, rocket ship financial growth, and cutting-edge technology. Our best-in-class AI research has been published in top journals including ICML, and we've raised over $148 million in funding from investors including former co-CEO of Whole Foods Market Walter Robb and Eric Schmidt's Innovation Endeavors. Fresh is the past, present, and future of our food system – the waste we create today will impact our planet for years to come. Join us as we continue to build a vibrant, diverse, and inclusive team that embodies our company’s values of proactivity, kindness, candor, and humility. Afresh provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity/expression, marital status, pregnancy or related condition, or any other basis protected by law. Here at Afresh, many of our employees work remotely provided that they reside in one of the following states: AL, AR, CA, CO, FL, GA, IL, KY, MA, MI, MT, MO, NV, NJ, NY, NC, OR, PA, TX, WA, UT, VA, WI .

Job Requirements

  • Significant experience designing and maintaining ETLs that process large-scale datasets.
  • Proficiency with Python, PySpark, SQL, and experience working on platforms/tools like Databricks, Snowflake, or DBT.
  • Strong problem-solving skills and the ability to work with ambiguous or incomplete requirements to deliver concrete, impactful solutions.
  • A focus on practical outcomes—you're skilled at balancing technical rigor with the need to get things done.
  • Experience working directly with complex, unclean datasets and finding innovative ways to process and analyze them.
  • A knack for identifying areas where tooling or automation can simplify workflows and reduce manual effort.
  • Excellent communication skills—you’re able to explain your ideas clearly to both technical and non-technical audiences.
  • Proven leadership in technical projects, with a willingness to mentor and help others grow.
  • Why Work Here
  • Join a mission-driven company reducing millions of pounds of food waste in grocery stores per year.
  • Work on challenging, real-world problems that have a direct impact on our customers.
  • Be part of a collaborative, supportive team where your ideas are valued and acted on.
  • Use cutting-edge tools and platforms to solve meaningful data challenges.
  • We’re looking for someone who thrives on tackling complex data problems and takes pride in building systems that work seamlessly at scale. If that sounds like you, we’d love to hear from you!
  • This position is not eligible for employer sponsorship.

Related Categories

Related Job Pages

More Data Engineer Jobs

Crossmedia logo

Engineer, Data & Solutions

Crossmedia

A channel-driven, future-built media agency, Crossmedia was founded in 2000 to push the boundaries of modern media. Also known as XMedia or XM, Crossmedia is he

Data Engineer108 days ago

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We are looking for a passionate and collaborative Engineer, Data and Solutions to join our technology team in a TEMPORARY role for a six month period. The technology team develops innovative solutions that empower our clients to make data-driven optimized media investment decisions with precision, scalability and speed. Your role as an Engineer is to ensure all Crossmedia accounts are being consistently supported and serviced at the highest levels of data accuracy, integrity, integration, and actionable insights. You’ll be responsible for developing and documenting best practices across data and AI operations in alignment with our mission. The Engineer is an integral member of the team involved in the “XM Product” that is delivered to each client, providing strategic guidance based on an in-depth understanding of each clients’ business, their target consumer and unique category dynamics. The Engineer will be a key partner for the Redbox team (data analytics) and is responsible for helping us deliver breakthrough solutions across advanced analytics, optimization, and audience practices. This includes supporting training initiatives, contributing to enhancing our culture, and mentorship of Crossmedians. Key Responsibilities - Developing and enhancing the Redbox integrated data layer across Measurement, Audience, Optimization, and Insights - Partnering with offshore data and development resources to ensure timely and quality delivery of data solutions - Partnering with clients, account leadership, strategy, planning, and Redbox team leads to develop best-in-class Artificial Intelligence strategies and solutions - Keeping abreast of fast-moving developments in AI and their application to the XM Product - Ensuring key Redbox data infrastructure is resilient and future-proofed - Support client and partner data integrations and developing solutions to automate and scale our audience, optimization, and advanced analytics solutions - Coordinate on data workflows and solutions requirements with Redbox practice leads - Champion a culture of continuous innovation and operational excellence for data and AI solutions - Coordinate and oversee implementation of solutions prototyping huddles and sprints - Responsible for the ownership and documentation of all media and solutions data infrastructure - Coordinate with Redbox, Strategy, Planning, and Marketplace teams to develop requirements for automation and AI investments - Collaborate with Analytics Operations leads to drive global scalability, ensuring localization and compliance with regional data regulations Qualifications - Five years of direct experience in integrated media data engineering, including data architecture and solutions development - A high preference for working within a media advertising agency - 4+ years of hands-on experience with media ETL platforms and data processing frameworks (e.g., Adverity, Funnel, Fivetran, dbt, Trifacta, Spark) - Expertise managing enterprise level implementation of cloud data solutions such as Snowflake, Databricks, etc. - Experience with data modeling, batch data pipeline design and implementation - Experience building batch or real-time data pipelines - Strong software development skills with high proficiency in Python/PySpark or Scala - High Proficiency in SQL - Experience in cloud-based infrastructures such as Azure, AWS, or GCP - Experience with orchestration platforms such as Airflow or Astronomer - Proven attention to detail, critical thinking, and the ability to work independently within a cross-functional team - Comfortable with CI/CD Pipelines (e.g., GitHub Actions) - Experience with Git version control, and other software adjacent tools - Understanding of the complexities of marketing data and their application to measurement methodologies including reporting, Media Mix Modeling, and optimization tools - Experience in the development and roll-out of automation solutions (including AI-based solutions where relevant) - Evidence of exceptional media analytics practices and leadership, including documentation of best practices across processes to validate/test data, remediate data quality issues, and reduce delivery bottlenecks - Desire to innovate to drive efficiency in operations - Demonstrated project management and organization skills - Ability to work and thrive in an interdisciplinary and collaborative work environment - Experience working across complex international agency structures - Team management, including managing and mentoring team members. Reviews, performance issues, timely reviews/feedback, active work distribution and fair rotations - Strong listening skills: believes good thinking can come from anyone and any place - A team player willing to compromise their point of view in support of others Requirements - We are open to a New York, Philadelphia, or remote hire, but candidates must be US based - Applicants must be authorized to work in the United States without sponsorship Benefits - Flexibility to work in hybrid manner with in-office and work from home options (depending on role) - Open/Flexible PTO with US & UK specific policies - Sponsored healthcare options and agency-wide physical & mental health support - 401k with company match (USA), and generous Pension (UK) - Paid sabbatical at significant milestone anniversaries - Generous paid parental leave policy - Life milestone recognition & support - The Pursuit of Happiness Fund devoted to helping Crossmedians find their happy (be it travel, enrichment class, fitness membership or professional development) - Cell phone/tech reimbursement - Student Loan payment plan (US) - Tuition reimbursement - Learning & Development and training programs - And burgers – lots and lots of burgers

United States
Job Closed
2U logo

Senior Data Engineer

2U

The company behind edX. We connect +81M learners to world-class, free-to-degree online education.

Data Engineer108 days ago
Full TimeRemoteTeam 1,001-5,000Since 2008H1B Sponsor

• Design and build robust, scalable, and high-performance ETL/ELT data pipelines • Develop and implement solutions using advanced programming languages (e.g., Python, SQL, DBT) • Optimize and performance-tune complex data workflows and queries to handle massive data volumes and ensure minimal latency • Assist with the design and implementation of data models for Data Warehouses (Snowflake etc.) • Implement data quality frameworks (validation, monitoring, and testing) to ensure data accuracy, consistency, and completeness • Establish comprehensive error logging and alerting systems for pipeline health and failure remediation • Apply DevOps practices to data infrastructure, often involving Infrastructure as Code (e.g., Terraform) • Effectively leverage knowledge, expertise and experience to lead and deliver projects • Effectively support and mentor data engineers • Stakeholder management throughout all business departments • Collaborate with other engineers and analysts to execute projects • Perform research and constantly stays on top of the industry’s trends • Engage and proactively seek opportunities for improvement through ongoing learning

South Africa
Job Closed
MediaRadar, Inc. logo

Data Engineer

MediaRadar, Inc.

Sales enablement platforms customized for media, and ad tech companies that help you close more deals.

Data Engineer108 days ago
OtherRemoteTeam 201-500Since 2007H1B No Sponsor

• Involve in Design, development, and maintenance of scalable ETL/ELT pipelines on Azure Databricks using Apache Spark (PySpark/Spark SQL). • Design and implement both batch and real-time data ingestion and transformation processes. • Build and manage Delta Lake tables, schemas, and data models to support efficient querying and analytics. • Consolidate and process large-scale datasets from various structured and semi-structured sources (e.g., JSON, Parquet, Avro). • Write optimized SQL queries for large datasets using Spark SQL and PostgreSQL. • Develop, schedule, and monitor workflows using Databricks Workflows, Airflow or similar orchestration tools. • Design, build, and deploy cloud-native, containerized applications on Azure Kubernetes Service (AKS) and integrate with Azure services. • Ensure data quality, governance, and compliance through validation, documentation, and secure practices. • Collaborate with data analysts, data architects, and business stakeholders to translate requirements into technical solutions. • Contribute to and enforce best practices in data engineering, including version control (Git), CI/CD pipelines, and coding standards. • Continuously enhance data systems for improved performance, reliability, and scalability. • Mentor junior engineers and help evolve team practices and documentation. • Stay up to date on emerging trends, technologies, and best practices in the data engineering space. • Work effectively within an agile, cross-functional project team.

United States
Job Closed
OtherRemoteTeam 501-1,000Since 2013H1B No Sponsor

• Translates business requirements into specifications that will be used to implement the required data load (ETL), reports and dashboards. • Gathers business requirements, development and delivery of business intelligence & reporting services and lead end to end BI delivery. • Develops and implements business intelligence, analytics, and dashboards using out-of-box features customizations and visualizations to support organizational initiatives. • Designs, models, develops & optimizes stored procedures to meet data management and data load and reporting objectives. • Designs and models data flows and ETL procedures ensuring data quality and integrity. • Ensures data sets feeding the analytics platforms are tuned for optimal performance. • Works with power users of the analytics/reporting tools to advise on best practices for Business Intelligence reporting. • Troubleshoots and resolves issues with the processes used and the content produced by the BI platform. • Works with business stakeholders to define and improve standardized and ad-hoc analytics/reporting capabilities. • Works as part of the BI team to maintain and develop all components of the BI platform. • Provides ongoing maintenance support through troubleshooting, report modifications and optimization. • Provides input into the technical architecture and the data warehouse technology stack. • Creates functional and technical design documents and maintains documentation for all reports and dashboards created or modified. • Responsibilities include orienting and training employees; assigning workload; planning, monitoring, and appraising job results; and coaching, counseling, and disciplining employees.

California
$130.3K - $195.5K / year
Job Closed