Job Closed
This listing is no longer active.
MasterClass is where anyone can learn from the world’s best.
Data Engineer
Location
California + 2 moreAll locations: California | New York | Washington
Posted
173 days ago
Salary
$142K - $170K / year
Seniority
Senior
Job Description
Data Engineer
MasterClass
• Design, build, and manage our data warehouse, data storage, and data ingestion solutions. • Implement robust and fault-tolerant systems for data ingestion and processing. • Develop canonical datasets to track key product metrics, including user growth, engagement, and revenue. • Understand and translate business needs into data models to support long-term, scalable, and reliable data pipelines • Enhance and maintain the Data Infrastructure using best practices and latest features to ensure high data quality. • Define and manage SLA’s for data sets and processes running in production • Continuously improve our data infrastructure and empower teams with the best data tooling and systems. • Build strong cross-functional partnerships with Data Analysts, Product Managers, and Software Engineers to understand data needs and deliver on those needs. • Participate in data architecture and engineering decisions, leveraging your strong experience and knowledge. • Build lineage and auditability into data pipelines • Be part of a data engineering team that is also responsible for the reliability of the data systems that are built and be available to respond to critical incidents as needed • Ensure the security, integrity, and compliance of data in accordance with industry and company standards.
Job Requirements
- 4+ years of experience in Data Engineering and Data Warehousing
- Experience scaling data environments with distributed processing technologies and frameworks.
- Advanced proficiency with SQL, Python, Postgres, and integrations via APIs
- Experience working in an AWS cloud environment in designing and implementing cloud data warehouses, other types of storage, and developing ETL/ELT pipelines
- Experience integrating and building a data platform in support of BI, Analytics, and Data Science
- Expertise with ETL schedulers such as Airflow, Dagster, Prefect, or similar frameworks.
- AI tools knowledge that includes an understanding of prompt engineering and how data impacts LLM performance in RAG pipelines; familiarity with modern AI technology stacks; ensuring high-quality data inputs for AI models; and integrating AI capabilities into business intelligence solutions.
- Strong communication skills, with the ability to initiate and drive projects proactively and accurately
- Eligible to work in the United States legally.
Benefits
- medical
- dental
- vision
- flexible PTO
- and more
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Lead and support the delivery of data platform modernization projects. • Design and develop robust and scalable data pipelines leveraging AWS native services. • Optimize ETL processes, ensuring efficient data transformation. • Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency. • Design automations and integrations to resolve data inconsistencies and quality issues • Perform system testing and validation to ensure successful integration and functionality. • Implement security and compliance controls in the cloud environment. • Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets. • Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.
Databricks Engineer, Data Engineer III
Recruiting.comWhen you choose us, you're choosing a company that values innovation, invests in its employees, and provides a supportive and engaging work environment. Join us in shaping the future of technology!
• Transforming enterprise business data into insights • Collaborate with business stakeholders to understand their data needs • Analyzing business requirements and translating them into technical specifications • Design, develop and implement data engineering solutions using Azure Databricks Lakehouse platform • Build Data and AI solutions leveraging Databricks components • Conduct detailed data analysis to identify existing data tables, design new tables, views and other objects • Apply AI and machine learning techniques to structured and unstructured data processing • Ensure data quality, integrity, and security throughout the data lifecycle • Collaborate with data scientists and analysts to meet data requirements • Communicate effectively with stakeholders on complex data concepts
• Análisis, diseño y desarrollo de soluciones de ingeniería de datos en entornos cloud. • Construcción y mantenimiento de pipelines de datos. • Tratamiento, integración y análisis de grandes volúmenes de información. • Optimización de procesos de datos en plataformas Microsoft Azure. • Data engineering y data analysis.
Platform Data Engineer – DataOps, Orchestration
AzumoNearshore Software Developer for Web, Mobile, Data and Cloud.
• Own and improve data orchestration patterns (Scheduling, Retries, Backfills). • Strengthen deployment and operational patterns to reduce "firefighting" for internal teams. • Ensure data pipelines and models are production-grade and operationally sound. • Use Terraform to support infrastructure-as-code for data platform components. • Document patterns and decisions to ensure internal teams can operate independently.
