Job Closed
This listing is no longer active.
Senior Software Engineer, AI Frameworks
Location
California
Posted
106 days ago
Salary
$152K - $241.5K / year
Seniority
Senior
Job Description
Senior Software Engineer, AI Frameworks
NVIDIA
• Design and implement end-to-end integrations of Grove with open-source AI frameworks (e.g., Dynamo, llm-d, Ray, PyTorch, and related ecosystem projects) • Build and maintain adapters, plugins, operators, and/or runtime components that enable Grove features to work smoothly across training and inference stacks • Partner with framework owners to upstream changes, contribute patches, and ensure long-term maintainability of integrations • Develop reference workflows, sample apps, and best-practice guides that accelerate adoption by users and partners • Optimize performance, scalability, and reliability for distributed training/inference, including multi-node and multi-GPU environments • Improve observability and operational readiness (metrics, logging, tracing, debugging tools) for Kubernetes-based deployments • Participate in technical design reviews, define APIs/contracts, and ensure compatibility across versions of frameworks and dependencies • Diagnose complex issues spanning containers, networking, scheduling, CUDA/GPU utilization, and framework runtime behavior.
Job Requirements
- BS/MS/PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience)
- 5+ years of proven experience in related field
- Hands-on experience integrating with at least one major AI framework/runtime (e.g., PyTorch, Ray, Triton Inference Server ecosystem, distributed runtimes, model serving stacks)
- Solid understanding of AI workloads: model development basics, training vs. inference tradeoffs, and performance considerations (throughput/latency, batching, memory)
- Experience with distributed systems concepts (RPC, scheduling, fault tolerance, resource management)
- Practical Kubernetes experience: deploying and operating services/jobs, Helm/Kustomize, operators/controllers (nice to have), and debugging clusters
- Familiarity with containers and cloud-native tooling (Docker, container registries, CI/CD pipelines)
- Strong software engineering experience in Go, C++ and/or Python, with a track record of shipping reliable systems
- Strong interpersonal skills and ability to collaborate across teams and with open-source communities
- Exceptional collaboration, communication, and documentation habits.
Benefits
- equity
- benefits
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Dictado de clase en vivo • Corrección de ejercicios y proyectos finales (en tiempo y forma) • Generar contenido de valor e interés quincenalmente • Planificación y preparado de clases a partir del material brindado por Nucba • Participación en encuentros extra-curriculares de la comunidad (charlas, after-class, jornadas, etc)
• Improve people’s lives and positively impact society • Develop technological solutions for cities • Collaborate with the team on technology projects
• Architect, Build and launch full-stack features and products with an emphasis on backend technologies. • Write code that serves as the bridge between consumers and robots.
• Develop, test, and maintain high-quality software • Collaborate with multidisciplinary teams to design, implement, and deliver effective solutions • Participate in code reviews, identify and fix issues, and adhere to development best practices • Work closely with cross-functional teams to meet client requirements • Stay up to date with technology trends and apply development best practices • Troubleshoot and provide support in resolving issues
