Airbnb logo
Airbnb

Airbnb is a community based on connection and belonging.

Senior Staff Machine Learning Engineer, Data & Eval

Machine Learning EngineerMachine Learning EngineerFull TimeRemoteSeniorTeam 5,001-10,000Since 2007H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

67 days ago

Salary

$244K - $305K / year

Seniority

Senior

Postgraduate Degree10 yrs expEnglish

Job Description

Senior Staff Machine Learning Engineer, Data & Eval

Airbnb

• In this Senior Staff role, you will set technical direction and lead execution for ML evaluation and the end-to-end data flywheel powering CSxAI products (e.g., assistive agents, issue resolution, and tooling). • Your work will define how we measure quality, how we turn feedback into learning signals, and how we continuously improve models and products safely and efficiently. • You will partner closely with product, engineering, design, operations to build evaluation systems that are trusted, scalable, and actionable - connecting offline metrics to online outcomes. • Work with large scale structured and unstructured data; explore, experiment, build and continuously improve Machine Learning models and pipelines for Airbnb product, business and operational use cases. • Work collaboratively with cross-functional partners including product managers, operations and data scientists, to identify opportunities for business impact; understand, refine, and prioritize requirements for machine learning, and drive engineering decisions. • Hands-on develop, productionize, and operate Machine Learning models and pipelines at scale, including both batch and real-time use cases. • Leverage third-party and in-house Machine Learning tools & infrastructure to develop reusable, highly differentiating and high-performing Machine Learning systems, enable fast model development, low-latency serving and ease of model quality upkeep.

Job Requirements

  • Educational Background: PhD in Computer Science, Mathematics, Statistics, or related technical field (or equivalent practical experience).
  • Industry Experience: 10+ years building, testing, and shipping ML/AI systems end-to-end; including 2+ years of experience with GenAI/LLM systems in production.
  • Leadership Experience: 5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and engineering/science direction across teams.
  • Technical Proficiency:
  • Deep expertise in evaluation methodology (offline/online alignment, metric design, human-in-the-loop evaluation, A/B testing, power analysis, regression testing).
  • Hands-on experience with GenAI systems, including orchestration, retrieval, tool calling, memory, etc.
  • Experience building data pipelines and quality systems (labeling workflows, dataset curation, versioning, monitoring, and governance).
  • Solid ML fundamentals and best practices (model selection, training/serving, monitoring, reliability, and model lifecycle management).

Benefits

  • This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.

Related Job Pages

More Machine Learning Engineer Jobs

Anlatan logo

Machine Learning Engineer

Anlatan

We're here to make ripples in the AI world.

Full TimeRemoteTeam 11-50H1B No Sponsor

• Working with our distributed training stack to start training runs and tracking them closely. • Contributing to our ML codebases and adding new models, algorithms and features. • Experimenting with new model architectures and designs, and getting them production ready. • Training and finetuning models, and adapting them to our products by taking tester feedback and iterating over the trained models.

United States
Janea Systems logo

Senior Software Engineer – Machine Learning

Janea Systems

Solving enterprises' most complex software engineering challenges.

Full TimeRemoteTeam 11-50H1B No Sponsor

• Design scalable data pipelines and infrastructure for enterprise ML systems • Implement ML models and systems into production • Collaborate with data scientists and software engineers • Deploy scalable tools and services for machine learning training and inference • Evaluate new technologies to improve ML system performance and reliability • Apply software engineering best practices, including CI/CD, to ML development • Facilitate the development and deployment of ML proof-of-concepts • Review, refactor, optimize, containerize, deploy, version, and monitor ML models • Implement monitoring and alerting solutions to ensure the reliability and performance of machine learning systems • Optimize and automate the machine learning deployment process to ensure efficiency and reproducibility • Collaborate with cross-functional teams to troubleshoot and resolve issues related to machine learning deployments • Stay updated with industry trends and apply knowledge to drive innovation • Promote industry best practices and enhance team expertise

United States
Aidaptive logo

Machine Learning Engineer

Aidaptive

End-to-end Artificial Intelligence (AI) and Machine Learning Platform powering High-Efficiency Commerce.

Full TimeRemoteTeam 11-50H1B No Sponsor

• Develop solutions for real world, large scale problems. • Design, develop, test, maintain and improve Machine Learning models. • Manage project priorities, deadlines, and deliverables.

India
Full TimeRemoteTeam 11-50H1B Sponsor

• Help transform healthcare through AI • Drive AI initiatives and collaborate with teams to leverage data effectively through model development and evaluation • Design and implement scalable Machine Learning infrastructure and solutions, ensuring reliability and performance • Establish data engineering best practices and promote standards that enhance data accessibility across teams • Create and maintain optimal AI pipeline architecture with high observability and robust operational characteristics • Champion responsible AI development by implementing and reviewing models that maximize data value while ensuring fairness and equity • Assemble large, complex data sets that address functional and strategic requirements • Identify, design, and implement process improvements to enhance efficiency and scalability • Create tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader • Develop efficient, reliable AI pipelines with strong monitoring and observability • Navigate and optimize our data ecosystem to drive meaningful insights • Design and implement comprehensive evaluation frameworks and benchmarks to rigorously assess model performance, accuracy and reliability

United States
$175K - $200K / year