Job Closed

This listing is no longer active.

NVIDIA logo
NVIDIA

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! Applications for this job will be accepted at least until June 15, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Senior System Software Engineer – Dynamo

Full-stack EngineerSoftware EngineerFull TimeRemoteSeniorTeam 10,001+Since 1993H1B SponsorCompany SiteLinkedIn

Location

California + 1 moreAll locations: California | Washington

Posted

41 days ago

Salary

$152K - $241.5K / year

Seniority

Senior

Postgraduate Degree3 yrs expEnglishDistributed SystemsOpen SourcePythonRust

Job Description

Senior System Software Engineer – Dynamo

NVIDIA

• Develop open source software to serve inference of trained AI models running on GPUs • Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM) • Innovate in the management and transfer of large KV caches across heterogeneous memory and storage hierarchies • Build new features to the Dynamo Rust Runtime Core Library and design, implement, and optimize distributed inference components in Rust and Python • Balance a variety of objectives: build robust, scalable, high performance software components to support our distributed inference workloads

Job Requirements

  • Masters or PhD or equivalent experience
  • 3+ years in Computer Science, Computer Engineering, or related field
  • Excellent Rust/Python/C++ programming and software design skills, including debugging, performance analysis, and test design
  • Experience with high scale distributed systems and ML systems

Benefits

  • equity
  • benefits

Related Job Pages

More Full-stack Engineer Jobs

H1 logo

Senior Software Engineer – API Development

H1

H1 is the connecting force for global HCP, clinical, scientific and research information.

Full TimeRemoteTeam 201-500H1B Sponsor

• At H1, we believe access to the best healthcare information is a basic human right • Our mission is to provide a platform that can optimally inform every doctor interaction globally • This promotes health equity and builds needed trust in healthcare systems • To accomplish this our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle

India
Agiloft logo

Senior Software Engineer – AI, Fullstack

Agiloft

The global standard in no-code contract lifecycle management (CLM) software.

Full TimeRemoteTeam 201-500Since 1991H1B Sponsor

• Lead the design and development of core platform features using Python and an API-first approach • Build scalable, reliable backend services that power our applications, integrating seamlessly with a modern cloud-based architecture • Implement front-end features and help manage a growing React project in TypeScript • Collaborate with design and product teams to ensure that what we’re building is scalable, maintainable, and secure • Contribute to infrastructure and deployment workflows in our AWS serverless environment (e.g., Lambda, API Gateway, DynamoDB) • Independently lead proof-of-concept projects and tackle complex architectural and engineering challenges • Leverage AI-assisted tools to enhance productivity, streamline workflows, and support day-to-day activities • Other duties as assigned

United States
Portless logo

Senior Software Engineer

Portless

Portless fulfills e-commerce orders directly from China, shaving months of time and saving you $$$ along the way.

Full TimeRemoteTeam 11-50H1B No Sponsor

- Lead the design and implementation of scalable and maintainable software architectures. - Drive technical strategy and define best practices for software development across engineering teams. - Mentor and guide engineers to enhance their professional growth and technical skills. - Collaborate with product management and stakeholders to create innovative software solutions that meet business needs. - Ensure the reliability, security, and performance of Portless’ software products. - Lead code reviews and promote high coding standards and quality assurance practices. - Evaluate and integrate new technologies and tools to improve efficiency and system capabilities. - Contribute to long-term planning and roadmap development aligned with company objectives.

United Kingdom
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

• Design and implement components of scalable, fault-tolerant web crawling and extraction pipelines • Write clean, production-grade code in Java and Python • Build and operate ETL/ELT pipelines for large-scale data extraction and transformation • Work with cloud infrastructure on GCP and AWS, primarily on GKE • Improve observability, reliability, and operational excellence across the systems you contribute to • Partner with product and data science teams to deliver impactful solutions • Contribute to code reviews, documentation, and knowledge sharing across the team • Stay current with evolving web technologies, anti-crawling mechanisms, and AI-powered extraction approaches

Washington
$140K - $220K / year