Job Closed
This listing is no longer active.
Described as the world's top internet television network, Netflix is a publicly-traded entertainment company offering video-on-demand and streaming media. As an
Senior Engineering Manager, Model Inference – Machine Learning Platform
Location
United States
Posted
142 days ago
Salary
$676K - $1,195K / year
Seniority
Senior
Job Description
Senior Engineering Manager, Model Inference – Machine Learning Platform
Netflix
• Set the vision and strategy for all aspects of model inference and serving at Netflix, ensuring our platform supports the next generation of ML innovation, including LLMs, GenAI, and real-time personalization. • Lead and develop a cohort of engineering managers and technical leads responsible for core functions, including model routing, inference systems, experimentation, serving frameworks, and the performance and scalability of model serving at Netflix. • Drive cross-team and cross-functional alignment, collaborating with ML researchers, product engineering, infrastructure, and platform partners to maximize business and member impact. • Champion operational excellence and continuous improvement, ensuring reliability, scalability, and cost-effectiveness across all model serving systems. • Define and communicate the pillar’s multi-year vision, technical strategy, and roadmap. • Anticipate future platform and business needs, especially as ML architectures and use cases evolve. • Drive the transition from legacy, domain-based serving to a unified, modular, and domain-agnostic serving platform. • Manage and mentor engineering managers and technical leads; build a strong leadership bench. • Foster a culture of high performance, candor, innovation, and inclusion, aligned with Netflix’s values. • Attract, hire, and retain outstanding talent across the pillar. • Set and uphold technical standards for reliability, scalability, and performance across all teams. • Oversee development of foundational serving infrastructure: real-time/batch inference, frameworks, experimentation, control plane, and tooling. • Ensure robust support for diverse model types (deep learning, LLMs, bandits, etc.), hardware targets (CPU/GPU), and SLAs. • Own operational health and reliability at scale, including observability, SLOs, and incident response. • Build and maintain strong partnerships with ML practitioners, product engineering, infrastructure, and platform teams. • Represent the Model Serving pillar to Netflix senior leadership, clearly communicating the vision, progress, and priorities. • Influence and drive alignment on platform direction, investment, and priorities.
Job Requirements
- Proven success managing multiple managers in high-scale ML infrastructure/platform environments.
- 10+ years of technical experience, with 5+ years in engineering management roles.
- Deep expertise in ML model serving, distributed systems, and high-scale production environments.
- Strategic thinking with a track record of delivering complex, cross-team initiatives.
- Excellent communication and stakeholder management skills.
- Experience driving organizational change and leading through ambiguity.
- Experience with modern ML frameworks (e.g., PyTorch, TensorFlow), inference engines (e.g., Triton, vLLM), and experimentation platforms is a strong plus.
- MS/PhD in Computer Science, Engineering, or related field, or equivalent experience preferred.
Benefits
- Health Plans
- Mental Health support
- 401(k) Retirement Plan with employer match
- Stock Option Program
- Disability Programs
- Health Savings and Flexible Spending Accounts
- Family-forming benefits
- Life and Serious Injury Benefits
- Paid leave of absence programs
- Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
- Full-time salaried employees are immediately entitled to flexible time off.
Related Guides
Related Categories
Related Job Pages
More Engineering Manager Jobs
Manager, Software Engineering
Bridgeway Benefit TechnologiesLeader in technology solutions for the Taft-Hartley industry.
• Collaborate closely with engineering, product, and business leaders to align technical execution with business goals. • Foster a culture of technical excellence, continuous learning, and innovation within the team. • Drive best practices for software development, including code reviews, testing, and CI/CD pipelines. • Ensure timely delivery of high-quality software solutions in an agile environment. • Mentor and develop engineers, helping them grow their skills and advance their careers. • Lead and manage a team of software engineers to develop scalable, secure, and high-performance applications - including hiring, training, and completing performance evaluations. • Work closely with architecture and platform teams to align on technical strategies and implementation. • Promote cross-functional collaboration. • Monitor KPIs and metrics to report out monthly to the CTO’s leadership team. • Stay current with emerging technologies and industry trends and integrate relevant innovations into the company’s IT infrastructure. • Participating in software solution design and architecture. • Ensuring code quality through unit testing and automated testing frameworks. • Working with other developers, stakeholders, and clients to understand requirements and deliver solutions. • Providing technical support and troubleshooting issues. • Creating and maintaining documentation throughout the software development lifecycle.
Engineering Manager
Red VenturesHeadquartered in Fort Mill, South Carolina, Red Ventures is an award-winning direct marketing company founded in 2000. Since that time, the company has earned a
• Manage a team of software engineers and position them for success through training, mentorship, and leadership • Contribute to key architectural decisions • Drive delivery and daily execution across an engineering team • Plan across one or more sprint teams • Partner with project managers to scope, plan, and drive execution from the team. • Develop working relationships with the Customer Experience, Product, and Creative teams to enable your team to deliver high-quality features and timely solutions to problems that arise • Work closely with the engineers to improve process and code quality • Responsible for soliciting feedback and delivering reviews • Work with the Technical Project Manager to navigate ceremonies and sprints, and manage the ticket workflow in Jira • Collaborate with Engineering Managers across the organization to align on talent expectations, innovation, and resourcing • Demonstrate project and roadmap planning skills • Assist with defining standards and requirements for tech tooling/workflows • Lead SRE, incident management, and Devops best practices for the engineering team • Manage the delivery of high-quality software while keeping morale high • Be a shepherd of culture
Engineering Manager
TixTrackTicket Sales Optimization: TixTrack can help increase ticket sales, optimize pricing, and better manage inventory.
• Lead, mentor, and grow the engineering team through regular one-on-ones, in-the-moment coaching, and goal-setting sessions, providing technical guidance to foster a culture of continuous improvement. • Oversee the software development lifecycle, ensuring projects are delivered on time and within scope. • Manage team capacity and workload, ensuring balanced distribution of tasks and responsibilities. • Direct your team’s execution using a servant and transformational leadership style, ensuring high velocity and quality in deliverables. • Participate in architectural discussions, code reviews, and troubleshooting to maintain high-quality code. • Partner with product managers and designers to define project requirements and implement the Empowered Product Team model, ensuring alignment on goals and shared understanding of project vision. • Foster long-term thinking and creative solutions that enhance customer experiences and drive product success. • Proactively identify opportunities for process improvements, automation, and optimization to enhance team effectiveness while maintaining high velocity, ownership, and accountability. • Represent your engineering team in cross-functional projects and engage with other leaders and stakeholders to advocate for the team’s needs and contributions. • Stay current with technology trends and engineering best practices. • Encourage the team to explore new methodologies and tools. • Identify and recommend organizational changes to improve team effectiveness and overall productivity. • Promote a culture of experimentation and iteration in the software development process, encouraging innovation and creative problem-solving.
Engineering Manager, Wikidata Platform
Wikimedia FoundationImagine a world in which every single human being can freely share in the sum of all knowledge.
• Lead timely, high-quality engineering delivery for WDQS and related query platform services • Ensure reliability, performance, and sustainability of existing and future query infrastructure • Oversee planning activities including estimation, resource allocation, and work break-down • Hire, onboard, mentor, and support the professional growth and performance of engineers on the Wikidata Platform team • Foster a collaborative, inclusive, and psychologically safe culture
