AI insights + over 600 years of NFL expertise.
Data Engineer
Location
California
Posted
100 days ago
Salary
0
Seniority
Senior
Job Description
Data Engineer
SumerSports
• Build and operate robust data pipelines for ingestion, cleaning, and transformation using Databricks, Airflow, or Dagster • Develop efficient ETL/ELT workflows in Python and SQL to support both batch and streaming workloads • Collaborate with ML and AI teams to deliver high-quality datasets for training, evaluation, and production features • Model and maintain structured data assets (Delta, Parquet, Iceberg) for reliability, versioning, and lineage tracking • Implement orchestration and monitoring — schedule jobs, track dependencies, and automate recovery from failures • Ensure data quality and compliance through validation frameworks, schema enforcement, and audit logging • Contribute to data platform evolution — evaluate tools, standardize best practices, and improve developer experience • Support performance and cost optimization across compute, storage, and orchestration systems
Job Requirements
- 3–6 years of experience as a Data Engineer or ETL Developer in a production environment
- Proficiency in Python and SQL; strong familiarity with Databricks, Spark, or equivalent big-data frameworks
- Experience with workflow orchestration tools such as Airflow, Dagster, Luigi or Prefect
- Deep understanding of data modeling, data warehousing, and distributed data processing
- Knowledge of modern data lakehouse architectures (Delta, Parquet, Iceberg)
- Familiarity with CI/CD, GitHub Actions, and data pipeline testing frameworks
- Comfort working in a cross-functional environment with ML, product, and analytics teams
Benefits
- Competitive Salary and Bonus Plan
- Comprehensive health insurance plan
- Retirement savings plan (401k) with company match
- Remote working environment
- A flexible, unlimited time off policy
- Generous paid holiday schedule - 13 in total including Monday after the Super Bowl
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer
RE PartnersWe make the Aspirational Attainable. We Do Better Together to Deliver Real Change.
• Design and build Spark data ETL pipelines on AWS data platform • Collaborate with cross functional teams (data scientists, fraud, marketing) to understand data needs and deliver solutions • Optimize data infrastructure • Ensure data quality and reliability • Innovate and follow best practices • Ensure operational excellence of the data platform
Lead Data Engineer
RE PartnersWe make the Aspirational Attainable. We Do Better Together to Deliver Real Change.
• Design and build Spark data ETL pipelines on AWS data platform. • Collaborate with cross functional teams such as data scientists, fraud, marketing and other business stakeholders to understand their data needs and deliver reliable solutions. • Optimize data infrastructure - Design and maintain robust data infrastructure by using modern data platform architecture. • Ensure data quality and reliability. • Innovate and follow best practices. • Ensure operational excellence of the data platform, including monitoring, incident response, performance optimization, and continuous improvement.
• Build CDC pipelines and real-time streaming (Kafka/Flink) • Design and maintain data models (raw to staging to core) • Implement observability, data transformations and quality checks • Own schema design for multi-tenant analytics • Tune query performance (Trino) and optimize storage (Iceberg compaction, indexing) • Support BI and analytics workloads • Contribute to infrastructure, CI/CD • Assist with infrastructure monitoring and observability
Senior Data Engineer, ADF, Databricks
BilligenceWe are a global BI Consultancy & Contingent Labor provider, focusing on contract IT recruitment and staff augmentation
• Design, develop, and maintain Azure Data Factory (ADF) pipelines for reliable data ingestion and orchestration • Develop and optimize Databricks notebooks for large-scale data processing and transformations • Implement robust ELT/ETL processes integrating multiple data sources into Snowflake • Perform data modeling using modern approaches, including Data Vault 2.0 • Write, optimize, and maintain complex SQL statements and SQL scripts • Ensure data quality, performance optimization, and scalability across data pipelines • Collaborate with stakeholders, data architects, and downstream analytics teams to deliver high-quality data solutions • Troubleshoot, monitor, and improve existing data workflows in production environment
