Job Closed
This listing is no longer active.
Senior Software Engineer – NIM Platform SDK and Framework
Location
California + 2 moreAll locations: California | New York | Texas
Posted
109 days ago
Salary
$184K - $356.5K / year
Seniority
Senior
Job Description
Senior Software Engineer – NIM Platform SDK and Framework
NVIDIA
• Develop and advance the inference microservice framework: OpenAI-compatible API endpoints, inference backend integrations (vLLM, SGLang, TensorRT-LLM, Dynamo), middleware, observability instrumentation, and production hardening across cloud, on-prem, and Kubernetes environments • Architect significant new features in open-source codebases, shepherding them through project acceptance and into production • Build and optimize high-performance model download and caching pipelines across multiple cloud storage backends (NGC, HuggingFace, S3, GCS) - parallel transfers, integrity verification, and seamless multi-cloud operability • Implement the model profile and manifest system that ensures NIMs are optimized for every NVIDIA GPU platform - profile selection, validation, and multi-GPU configuration • Develop and refine cloud microservice patterns - service discovery, health checking, graceful degradation, API gateway integration, and end-to-end request lifecycle management - to ensure NIMs operate reliably at scale in diverse cloud deployment environments • Be a role model for high-quality code across Python, Rust, and C/C++, and model guidelines in test-driven development, agentic AI-assisted development, code review, and cross-team collaboration • Mentor teammates and establish high engineering standards for container quality, security, and operability
Job Requirements
- BS or MS in Computer Science, Computer Engineering, or related field (or equivalent experience)
- 8+ years of demonstrated experience developing performant microservice, cloud software and/or platform infrastructure roles
- Deep technical expertise in cloud-native microservice architecture, including service mesh, API gateways, load balancing, and distributed system build patterns
- Expertise in high-performance data pipelines with parallel I/O, caching strategies, and integrity verification across distributed storage systems
- Solid understanding of containerized application delivery using technologies such as Docker, Kubernetes, and Helm
- Understanding of application security principles, including secure coding practices, vulnerability mitigation, secrets management, and supply chain integrity for containerized environments
- Strong problem-solving skills grounded in first-principles reasoning and critical analysis
- Excellent programming skills in Python and Rust, with strong foundations in algorithms, development patterns, and software engineering principles
Benefits
- Eligible for equity
- Benefits offered
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Dictado de clase en vivo • Corrección de ejercicios y proyectos finales (en tiempo y forma) • Generar contenido de valor e interés quincenalmente • Planificación y preparado de clases a partir del material brindado por Nucba • Participación en encuentros extra-curriculares de la comunidad (charlas, after-class, jornadas, etc)
• Improve people’s lives and positively impact society • Develop technological solutions for cities • Collaborate with the team on technology projects
• Architect, Build and launch full-stack features and products with an emphasis on backend technologies. • Write code that serves as the bridge between consumers and robots.
• Develop, test, and maintain high-quality software • Collaborate with multidisciplinary teams to design, implement, and deliver effective solutions • Participate in code reviews, identify and fix issues, and adhere to development best practices • Work closely with cross-functional teams to meet client requirements • Stay up to date with technology trends and apply development best practices • Troubleshoot and provide support in resolving issues




