Job Closed

This listing is no longer active.

Airbnb logo
Airbnb

Airbnb is a community based on connection and belonging.

Senior Data Engineer, Guest & Host

Data EngineerData EngineerFull TimeRemoteSeniorTeam 5,001-10,000Since 2007H1B SponsorCompany SiteLinkedIn

Location

India

Posted

75 days ago

Salary

₹4,500K - ₹6,500K / year

Seniority

Senior

Job Description

Senior Data Engineer, Guest & Host

Airbnb

• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds. • Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy. • Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework • Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements. • Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity • Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues

Job Requirements

  • 6+ years of relevant industry experience
  • BE/B.tech in computer science or relevant technical field
  • Extensive experience designing, building, and operating robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and handling data at the petabyte scale.
  • Strong knowledge of Java, Scala, or Python, and expertise with data processing technologies and query authoring (SQL).
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
  • Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
  • Excellent written and verbal communication skills

Benefits

  • bonuses
  • Employee Travel Credits

Related Categories

Related Job Pages

More Data Engineer Jobs

Qodea logo

Senior Data Engineer

Qodea

Qodea (formerly Appsbroker CTS) is Europe's largest Google Premier only transformation partner.

Data Engineer75 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

The purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets. This role is designed for impact, and we believe our best work happens when we connect. While we operate a flexible model, we expect you to spend time on site (at our offices or a client location) for collaboration sessions, customer meetings, and internal workshops. • Develop and maintain automated data processing pipelines using Google Cloud: - Design, build, and maintain data pipelines to support data ingestion, ETL, and storage - Build and maintain automated data pipelines to monitor data quality and troubleshoot issues • Implement and maintain databases and data storage solutions: - Stay up-to-date with emerging trends and technologies in big data and data engineering - Ensure data quality, accuracy, and completeness • Implement and enforce data governance policies and procedures to ensure data quality and accuracy: - Collaborate with data scientists and analysts to design and optimise data models for analytical and reporting purposes - Develop and maintain data models to support analytics and reporting - Monitor and maintain data infrastructure to ensure availability and performance

Romania
Job Closed

Role Description We are seeking an ETL Specialist who will play a key role in ensuring the secure, accurate, and efficient transfer of digital files from various veterinary Practice Information Management Systems (PIMS) to business partners. This role requires strong technical skills, a structured and detail-oriented approach, and the ability to work effectively across multiple file sources, tools, and environments. Success in this role means consistently delivering complete and high-quality attachment sets, maintaining efficient and standardized workflows, identifying data issues proactively, and collaborating closely with cross-functional teams. This is a full-time, remote position ideal for someone who thrives in technical environments and enjoys problem-solving. Responsibilities - Collect, extract, and migrate attachment files referenced within veterinary PIMS systems. - Retrieve files from various sources, including on-premises PIMS servers, email-delivered download links, and internal applications. - Perform file conversions, naming normalization, and file-type modifications as needed. - Validate file integrity, identify missing or inaccessible files, and communicate limitations to relevant stakeholders. - Use scripting tools (PowerShell or Python) to build or modify custom automation workflows. - Apply ELT (Extract, Load, Transform) concepts to streamline file handling and transformation processes. - Execute secure file transfers using SFTP, HTTPS, and token-based authentication. - Utilize cloud storage platforms, remote-access utilities, and data-management tools to retrieve and deliver files. Requirements - Experience working with Windows and macOS environments. - Proficiency in PowerShell and/or Python for scripting and automation. - Understanding of ELT concepts and their practical application. - Experience with cloud services such as: - Microsoft Azure - Microsoft Storage Explorer - Amazon S3 - Familiarity with remote-access and data transfer tools including TeamViewer, AnyDesk, Cloudberry, FileZilla, AzCopy, and Remote Desktop. - Proficiency with productivity and communication tools: Microsoft Teams, Office, Outlook, Jira. - Familiarity with database browsing tools such as DBeaver. - Basic understanding of secure data transfer protocols. Nice to Have - Previous experience in veterinary PIMS data handling or data migration. - Experience with file-based extraction from legacy systems. - Exposure to cloud-based storage workflows or enterprise data migration pipelines. - Familiarity with generative AI tools for documentation, automation, or workflow enhancement. - Experience working in fast-paced or mid-sized technical environments. Benefits - Competitive compensation and benefits package. - Opportunities for growth and professional development/continuous learning. - Flexible work arrangements. - Comprehensive leave policies, including PTO & holidays. - Monthly connectivity allowance.

Worldwide
Job Closed
bet365 logo

Data Engineer GCP

bet365

At bet365, we're one of the world's leading online gambling companies, revolutionising the industry since 2000. Founded by Denise Coates CBE, we now employ over 9,000 people and serve over 100 million customers in 27 languages. Focus on In-Play betting has solidified our market-leading position. Offering an unmatched experience across 96 sports and 700,000 streaming events. Handling over 6 billion HTTP requests daily and processing more than 2 million bets per hour at peak. Empowering employees to push boundaries and explore new ideas. Cultivating a culture that celebrates and rewards creativity. Breaking new ground in software innovation.

Data Engineer75 days ago
Full TimeRemoteTeam 5,001-10,000Since 2000

Role Description As a Data Engineer, you will play a key role in creating, migrating, and maintaining regulatory reporting systems on Google Cloud Platform (GCP). - The Regulatory Data team is responsible for building and maintaining near real-time and batch reporting systems to fulfill regulatory requirements. - The team utilizes complex business logic to transform internal data models into those required by industry regulators and third parties. - You will support the migration from on-premise SQL Server systems to GCP as the team creates new GCP reporting systems. - Develop new cloud-native solutions and explore AI-driven development and automation to improve efficiency, consistency, and reliability across the team's processes. Qualifications - Experience with Google BigQuery. - SQL development experience, with the ability to write complex queries, stored procedures, and performance-tune data-intensive workloads. - Familiarity with GCP services such as Cloud Storage, Cloud Functions, Pub/Sub, or Cloud Composer. - Experience with data pipeline development (ETL/ELT) and orchestration tooling. - Exposure to Infrastructure as Code such as Terraform, and CI/CD pipelines such as Git, GitLab. - Methodical, with high attention to detail and the ability to break down complex requirements into simple solutions. - Interest in AI-assisted development tooling, such as Claude Code. - Ability to work to deadlines in a fast-paced, reactive environment. - SQL Server experience to support legacy systems during migration. Requirements - Developing and maintaining regulatory data submission systems, both existing on-premise and new cloud-based solutions in GCP/BigQuery. - Building and maintaining automated data pipelines for ingestion, transformation, and loading of regulatory data. - Supporting the migration of legacy SQL Server solutions to BigQuery, working closely with seniors and technical leads on architecture and data modelling. - Implementing data validation, monitoring, and alerting to ensure accuracy, consistency, and reliability of regulatory submissions. - Leveraging AI tooling, such as Claude Code, and contributing to the team's automation strategies to reduce manual effort and improve quality. - Participating in code reviews and adhering to departmental standards and the development process. - Conducting QA to ensure solutions are accurate, efficient, and performant. - Creating and maintaining relevant documentation. - Collaborating with other team members to deliver high-quality solutions within required timeframes. Benefits - Creating an environment where everyone feels welcome, respected, and valued. - Opportunities for growth and development, regardless of background. - Commitment to continuous improvement and striving to be better.

United Kingdom
Coupa Software logo

AI Engineer, Data Pipeline

Coupa Software

Spend is the fuel to help your company deliver performance, profitability, and purpose!

Data Engineer75 days ago
Full TimeRemoteTeam 1,001-5,000Since 2006H1B Sponsor

• Build data ingestion pipelines to extract and transform enterprise data. • Implement data cleansing and normalization routines. • Write and maintain ETL jobs using Spark/PySpark on cloud infrastructure. • Implement data validation and quality checks at each pipeline stage. • Build automated data export jobs for model training datasets. • Support feature extraction from enterprise schemas. • Monitor pipeline health, troubleshoot failures, and optimize performance. • Document data lineage, schemas, and transformation logic.

India
Job Closed