Airbnb is a community based on connection and belonging.
Senior Staff Machine Learning Engineer, Data & Eval
Location
United States
Posted
67 days ago
Salary
$244K - $305K / year
Seniority
Senior
Job Description
Senior Staff Machine Learning Engineer, Data & Eval
Airbnb
• In this Senior Staff role, you will set technical direction and lead execution for ML evaluation and the end-to-end data flywheel powering CSxAI products (e.g., assistive agents, issue resolution, and tooling). • Your work will define how we measure quality, how we turn feedback into learning signals, and how we continuously improve models and products safely and efficiently. • You will partner closely with product, engineering, design, operations to build evaluation systems that are trusted, scalable, and actionable - connecting offline metrics to online outcomes. • Work with large scale structured and unstructured data; explore, experiment, build and continuously improve Machine Learning models and pipelines for Airbnb product, business and operational use cases. • Work collaboratively with cross-functional partners including product managers, operations and data scientists, to identify opportunities for business impact; understand, refine, and prioritize requirements for machine learning, and drive engineering decisions. • Hands-on develop, productionize, and operate Machine Learning models and pipelines at scale, including both batch and real-time use cases. • Leverage third-party and in-house Machine Learning tools & infrastructure to develop reusable, highly differentiating and high-performing Machine Learning systems, enable fast model development, low-latency serving and ease of model quality upkeep.
Job Requirements
- Educational Background: PhD in Computer Science, Mathematics, Statistics, or related technical field (or equivalent practical experience).
- Industry Experience: 10+ years building, testing, and shipping ML/AI systems end-to-end; including 2+ years of experience with GenAI/LLM systems in production.
- Leadership Experience: 5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and engineering/science direction across teams.
- Technical Proficiency:
- Deep expertise in evaluation methodology (offline/online alignment, metric design, human-in-the-loop evaluation, A/B testing, power analysis, regression testing).
- Hands-on experience with GenAI systems, including orchestration, retrieval, tool calling, memory, etc.
- Experience building data pipelines and quality systems (labeling workflows, dataset curation, versioning, monitoring, and governance).
- Solid ML fundamentals and best practices (model selection, training/serving, monitoring, reliability, and model lifecycle management).
Benefits
- This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Related Guides
Related Job Pages
More Machine Learning Engineer Jobs
• Working with our distributed training stack to start training runs and tracking them closely. • Contributing to our ML codebases and adding new models, algorithms and features. • Experimenting with new model architectures and designs, and getting them production ready. • Training and finetuning models, and adapting them to our products by taking tester feedback and iterating over the trained models.
Senior Software Engineer – Machine Learning
Janea SystemsSolving enterprises' most complex software engineering challenges.
• Design scalable data pipelines and infrastructure for enterprise ML systems • Implement ML models and systems into production • Collaborate with data scientists and software engineers • Deploy scalable tools and services for machine learning training and inference • Evaluate new technologies to improve ML system performance and reliability • Apply software engineering best practices, including CI/CD, to ML development • Facilitate the development and deployment of ML proof-of-concepts • Review, refactor, optimize, containerize, deploy, version, and monitor ML models • Implement monitoring and alerting solutions to ensure the reliability and performance of machine learning systems • Optimize and automate the machine learning deployment process to ensure efficiency and reproducibility • Collaborate with cross-functional teams to troubleshoot and resolve issues related to machine learning deployments • Stay updated with industry trends and apply knowledge to drive innovation • Promote industry best practices and enhance team expertise
Machine Learning Engineer
AidaptiveEnd-to-end Artificial Intelligence (AI) and Machine Learning Platform powering High-Efficiency Commerce.
• Develop solutions for real world, large scale problems. • Design, develop, test, maintain and improve Machine Learning models. • Manage project priorities, deadlines, and deliverables.
• Help transform healthcare through AI • Drive AI initiatives and collaborate with teams to leverage data effectively through model development and evaluation • Design and implement scalable Machine Learning infrastructure and solutions, ensuring reliability and performance • Establish data engineering best practices and promote standards that enhance data accessibility across teams • Create and maintain optimal AI pipeline architecture with high observability and robust operational characteristics • Champion responsible AI development by implementing and reviewing models that maximize data value while ensuring fairness and equity • Assemble large, complex data sets that address functional and strategic requirements • Identify, design, and implement process improvements to enhance efficiency and scalability • Create tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader • Develop efficient, reliable AI pipelines with strong monitoring and observability • Navigate and optimize our data ecosystem to drive meaningful insights • Design and implement comprehensive evaluation frameworks and benchmarks to rigorously assess model performance, accuracy and reliability




