Job Closed

This listing is no longer active.

Lyft logo
Lyft

Lyft, established in 2012 by Logan Green and John Zimmer, is a transportation network company offering a mobile application that promotes ride-sharing by connec

Data Engineer

Location

Ukraine

Posted

84 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

Lyft

• Owner of the core data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft • Evolve data model and data schema based on business and engineering needs • Implement systems tracking data quality and consistency • Develop tools supporting self-service data pipeline management (ETL) • SQL and MapReduce job tuning to improve data processing performance • Write well-crafted, well-tested, readable, maintainable code • Participate in code reviews to ensure code quality and distribute knowledge • Collaborate cross-functionally with product, engineering, data science, and marketing teams to understand business problems and align on prioritization and solutions

Job Requirements

  • 4+ years of professional experience in data engineering, ideally with large-scale distributed systems.
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
  • Strong skills in a scripting language (Python, Go)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • 1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Comfortable working directly with data analytics to bridge Lyft’s business goals with data engineering
  • Preferred to have experience of building and maintaining customer care related data tables as a Data Engineer for large organizations.

Benefits

  • Professional and stable working environment.
  • The latest technology and equipment you need.
  • Potential to work remotely, including out of country (dependent on work authorizations).
  • 28 calendar days for vacation and up to 5 paid sick days.
  • 18 weeks of paid parental leave. Biological, adoptive and foster parents are all eligible.
  • Mental health benefits.
  • Family building benefits.

Related Categories

Related Job Pages

More Data Engineer Jobs

Tiger Analytics logo

Data Engineering Lead

Tiger Analytics

AI & Analytics for today’s business challenges.

Data Engineer84 days ago
Full TimeRemoteTeam 1,001-5,000Since 2011H1B Sponsor

• Lead and manage data engineering projects from conception to deployment, ensuring alignment with stakeholder needs. • Design, build, and maintain scalable data pipelines to support data ingestion, transformation, and storage. • Collaborate with data scientists and analysts to ensure that data needs are met and provide technical guidance on best practices. • Implement and maintain data quality and integrity measures. • Utilize cloud-based data platforms and technologies, particularly Azure, to enhance data accessibility and usability. • Mentor and guide junior team members in data engineering concepts and practices. • Identify opportunities for process improvements and implement solutions that enhance efficiency, scalability, and performance.

Mexico
Cascade Financial Services logo

Data Engineer

Cascade Financial Services

Serving the American Dream through Attainable Home Ownership

Data Engineer84 days ago
OtherRemoteTeam 201-500Since 1999H1B Sponsor

• Apply an in-depth understanding of data structures and information content. • Select, deploy, and manage the systems and infrastructure required for a data processing pipeline in support of the project requirements. • Investigate, create, and maintain data flows, data content, data element definitions with a goal of enterprise Master data integration. • Determine technical breath in data profiling from different sources and determine whether and how data can support business and data requirements of its intended use. • Develop and maintain common business definitions and metadata criteria for consistent metrics reporting across the enterprise. • Design the architecture for new data and analytics platform to support analytics and data science and machine learning. • Design the data models and data movement processes that support analytics and data science. • Recommend and implement patterns and best practices for data engineering. • Ensure quality processes are built into the design of the platform. • Understand the architectural difference between solution approaches and communicate the advantages/disadvantages of your recommendation to both technical and non-technical audiences. • Design and develop analytics and interactive visualizations that create business insights and clearly communicate data and trends. • Develop complex SQL queries to obtain data from our source systems. • Perform data validation and quality assurance to ensure data integrity and accuracy. • Collaborate with IT and business partners to identify data sources and align data domains to authoritative sources of data. • Enforce tactical enforcement of Data Governance policies and rules. • Research new technologies while keeping up-to-date with technological developments in relevant areas of Data Governance, Master Data, and Data Quality.

United States
$117.4K / year
Job Closed

Role Description Turn 10 Studios is seeking a Data Engineer to join the Data Pipeline team and help design, build, and support modern data platforms that power studio‑wide decision making. This role focuses on developing scalable, high‑quality data pipelines and analytics systems using Azure‑based technologies. The Data Engineer will partner closely with business, design, test, and development teams to shape how data is captured, modeled, and consumed, enabling test‑driven methodologies and a culture of data‑driven development. - Design, build, and maintain scalable ETL and ELT pipelines supporting real‑time and batch analytics workloads. - Develop and optimize data models within lakehouse and warehouse architectures to support analytics and reporting needs. - Implement data processing solutions using Databricks, Azure Data Factory, Azure Synapse Analytics, and related services. - Ensure data quality, reliability, and performance across ingestion, transformation, and consumption layers. - Partner with cross‑functional stakeholders to define data requirements and improve how data is captured and used. - Create and maintain clear, concise technical documentation for data pipelines, models, and processes. - Establish documentation and knowledge‑sharing practices that improve discoverability and reuse across teams and studios. - Advocate for modern engineering practices and contribute to the evolution of the studio’s data architecture. Performance will be measured based on: - Quality, reliability, and scalability of delivered data solutions - Adherence to project timelines and delivery commitments - Effectiveness of documentation and knowledge sharing - Collaboration with stakeholders and contribution to data‑driven decision making Qualifications - Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical discipline, or equivalent professional experience. - Demonstrated expertise in SQL for analytics and data engineering use cases. - Proven experience designing and implementing scalable ETL processes, including data movement, orchestration, and quality controls. - Hands‑on experience with modern big data analytics platforms, including data lakes, distributed processing frameworks, and columnar storage formats. - Experience building and operating cloud‑hosted data systems, with strong preference for Microsoft Azure. Requirements - Azure Data Factory, Databricks, Azure Synapse Analytics - Spark‑based data processing - Data lake and lakehouse architectures - Parquet and Delta Lake formats - Azure Data Explorer and Kusto Query Language - Data modeling for analytics and reporting - Data quality, governance, and observability practices Benefits - Opportunity to work on the front edge of modern data engineering using Databricks, Azure Synapse Analytics, and Azure Data Explorer. - Direct impact on studio‑wide decision making, test‑driven development, and data‑driven culture. - Exposure to large‑scale lakehouse and warehouse analytics systems handling both real‑time and batch data. - Collaborative environment where data engineering directly influences business, design, testing, and development outcomes. Assessment Process Candidates will be evaluated through a combination of technical interviews, practical problem‑solving discussions, and assessment of prior experience building and supporting modern data platforms. Emphasis will be placed on applied data engineering skills, architectural judgment, and documentation practices.

United States
$58 - $60 / year
Job Closed
OtherRemoteTeam 201-500

PROJECT OVERVIEW Our client, a leading global provider of high-quality food products, including well-known brands and value-added premium products, is seeking a Data Engineer to support the development and evolution of a modern cloud data platform built on Snowflake. The role will focus on building scalable data pipelines, supporting platform migration from Dataiku to DBT, and enabling high-quality data for analytics and business intelligence. IN THIS ROLE, YOU WILL - Design and develop data pipelines and transformation workflows using DBT. - Build and optimize data models within Snowflake to support analytics and reporting. - Support the migration of orchestration and transformation processes from Dataiku to DBT. - Develop integrations between enterprise systems including CRM platforms and analytics environments. - Ensure data quality, consistency, and reliability across the data platform. - Implement and maintain data transformation best practices and coding standards. - Produce clear technical documentation for pipelines, models, and processes. - Collaborate with BI engineers, PM/BA, and Data Architects on platform design and improvements. - Proactively identify performance issues and optimize data pipelines. IF YOU ARE - 4+ years of experience in data engineering or data platform development. - Strong experience with Snowflake. - Hands-on experience with DBT for data transformations. - Advanced SQL skills and experience designing data models. - Experience building ETL/ELT pipelines in modern data platforms. - Familiarity with data integration patterns and enterprise system integrations. - Experience working in collaborative analytics engineering environments. - Ability to work with distributed teams with at least 4 hours overlap with US time zones. AS AN OPINOV8R, YOU WILL HAVE - Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide. - Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere. - Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity. - Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience. - Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers. HOW’S THE HIRING PROCESS GOING We strive to make our hiring process smooth and transparent to find the perfect match for both sides. Steps may differ depending on the role, but here’s what to expect: - Initial Interview: If your background fits the role, we’ll invite you for an interview with a Talent Acquisition Specialist. - Technical Interview: Depending on the position, you may complete a technical assessment or test task. - Client Interview - Final Decision: After all steps, we’ll get back to you with the result and next steps.

United States
Job Closed