NVIDIA logo
NVIDIA

Based in Santa Clara, California, with additional offices throughout the U.S., South America, and Canada, NVIDIA is committed to fostering a work environment wh

Engineering Manager, Deep Learning Inference

Location

California + 2 moreAll locations: California | District Of Columbia | Illinois

Posted

4 days ago

Salary

$224K - $431.3K / year

Seniority

Senior

Postgraduate Degree6 yrs expEnglishPython

Job Description

Engineering Manager, Deep Learning Inference

NVIDIA

• Lead, mentor, and scale a high-performing engineering team focused on deep learning inference and GPU-accelerated software • Guide the strategy, roadmap, and execution of NVIDIA's OSS inference frameworks engineering • Partner with internal compiler, libraries, and research teams to deliver end-to-end optimized inference pipelines across NVIDIA accelerators • Oversee performance tuning, profiling, and optimization of large-scale models for LLM, multimodal, and generative AI applications • Guide engineers in adopting best practices for CUDA, Triton, CUTLASS, and multi-GPU communications (NIXL, NCCL, NVSHMEM) • Represent the team in roadmap and planning discussions, ensuring alignment with NVIDIA’s broader AI and software strategies • Foster a culture of technical excellence, open collaboration, and continuous innovation

Job Requirements

  • MS, PhD, or equivalent experience in Computer Science, Electrical/Computer Engineering, or a related field
  • 6+ overall years of software development experience, including 3+ years in technical leadership or engineering management
  • Strong background in C/C++ software design and development; proficiency in Python is a plus
  • Hands-on experience with GPU programming (CUDA, Triton, CUTLASS) and performance optimization
  • Proven record of deploying or optimizing deep learning models in production environments
  • Experience leading teams using Agile or collaborative software development practices

Benefits

  • highly competitive salaries
  • comprehensive benefits package

Related Categories

Related Job Pages

More Engineering Manager Jobs

PeopleGrove logo

Engineering Manager

PeopleGrove

A Career Access Platform™, our mission is to ensure every learner has access to the people & networks needed to succeed.

Full TimeRemoteTeam 51-200Since 2015H1B No Sponsor

• Lead cross-functional engineering teams to deliver scalable, high-quality software products. • Drive technical excellence, people development, execution, and operational excellence while working closely with Product, QA, Design, and Architecture teams.

India
CrowdStrike logo

Engineering Manager – Production Services Infrastructure

CrowdStrike

CrowdStrike has redefined security with the world’s most advanced cloud-native platform that protects and enables the people, processes and technologies that drive modern enterprise. Tested and proven, the world's largest organizations trust CrowdStrike to stop breaches with unparalleled protection against the most sophisticated cyberattacks. The CrowdStrike culture has been built upon our Core Values since the day we began. We are Fanatical About the Customer, Relentlessly Focused on Innovation and believe that our Limitless Passion drives Unlimited Potential for every CrowdStriker. As a purpose-built remote-first company, we believe cultivating a connected culture for every employee, no matter where they are in the world, is a key ingredient in building a high-performing, diverse team. We don’t have a mission statement. We’re on a mission—to stop breaches. Ready to join a mission that matters?

Full TimeRemoteTeam 5,001-10,000Since 2011H1B Sponsor

• Lead and scale an engineering team responsible for CrowdStrike's global production infrastructure • Drive technical strategy for large-scale distributed systems supporting millions of security endpoints • Implement AI/ML solutions for predictive maintenance, anomaly detection, and automated remediation • Build and mentor a world-class team while establishing career development frameworks • Drive automation initiatives reducing manual operational overhead by thousands of hours annually • Establish SLAs, operational metrics, and incident response processes for global infrastructure reliability

California
$120K - $180K / year
SitusAMC logo

Software Engineering Manager

SitusAMC

SitusAMC is a privately held financial services and real estate company. Located in New York, New York, the company was founded in 1985 to provide advisory solu

• Serve as a full-stack developer to produce scalable software solutions. • Lead the design, development, testing, deployment, and support of new and existing software products, applications, services, and components for client-facing and proprietary platforms. • Drive the delivery of high-quality software solutions that align with business objectives, client needs, product strategy, and long-term technology goals. • Partner with product, business, architecture, QA, security, DevOps, and other cross-functional teams to translate business requirements into scalable, maintainable technical solutions. • Guide teams through Agile delivery practices, including short- and long-term planning, backlog alignment, sprint execution, demonstrations of working software, and delivery accountability. • Support the creation of Minimum Viable Products that deliver business value quickly while maintaining quality, scalability, and architectural integrity. • Serve as a technical leader and escalation point for complex development, integration, troubleshooting, testing, and debugging efforts. • Contribute to and help shape the technical roadmap for projects, products, and platforms, ensuring alignment with future customer and business needs. • Define and guide system, technical, and application architecture decisions that promote reuse, componentization, extensibility, maintainability, performance, and security. • Evaluate new platforms, programming languages, frameworks, tools, and software products to determine feasibility and value for incorporation into company solutions. • Maintain strong working knowledge across modern software development environments and technologies, including Java, C#, .NET/.NET Core, AWS, Azure, API integrations, RESTful services, structured and unstructured databases, web technologies, and JavaScript frameworks such as Angular, Vue, and React. • Oversee the execution of software engineering plans, development processes, standards, and documentation to ensure consistency, repeatability, and delivery discipline. • Ensure software solutions meet functional and non-functional requirements, including quality, security, stability, scalability, modifiability, performance, and data protection expectations. • Provide solutions and alternatives to resolve technical or delivery challenges that impact timelines, scalability, performance, production readiness, or implementation success. • Analyze code, architecture, and system behavior to identify causes of issues and guide corrective actions as needed. • Establish and monitor delivery metrics related to turnaround time, workload, rework, defects, test coverage, and team performance to support continuous improvement. • Stay informed on business initiatives, product objectives, infrastructure priorities, and development architecture considerations that influence engineering decisions. • Use data, user insights, and product feedback to identify opportunities, improve user experiences, and guide technical solutions that solve customer and business problems. • Run experiments on new and existing product features, evaluate results, and influence teams and leadership toward modern, effective engineering solutions. • Research emerging technologies, methodologies, and capability models to improve quality, predictability, delivery efficiency, and cost effectiveness. • Lead by example with a positive, growth-oriented mindset and a commitment to collaboration, accountability, and continuous improvement. • Mentor, coach, and develop software engineers, technical leads, PODs, and delivery teams to strengthen execution, technical capability, and overall performance. • Manage software service delivery for internal and external stakeholders, ensuring tasks, assignments, project activities, and timelines remain aligned with business priorities.

United States
$175K - $235K / year
Search logo

NOC Manager – Network Operations, Engineering

Search

Search. Staffing and recruiting. Contact us today: search.co.uk

Full TimeRemoteTeam 501-1,000Since 1987

• Manage daily NOC performance, resource allocation, workforce planning, and SLA/KPI delivery across all managed clients. • Act as the senior technical escalation point for major incident management, complex network fault resolution, and technical governance. • Develop scalable service delivery frameworks, enhance service catalogs, and drive operational efficiency and automation. • Coach, develop, and empower a high-performing team of network engineers and NOC officers. • Serve as the primary operational contact for key client escalations and conduct periodic service performance reviews. • Drive proactive monitoring initiatives, post-incident reviews (PIR), and root-cause analyses to prevent repeat incidents.

Philippines
Job Closed