Job Closed
This listing is no longer active.
Software Engineer, AI and DL Kernel Libraries
Location
California
Posted
66 days ago
Salary
$124K - $195.5K / year
Seniority
Mid Level
Job Description
Software Engineer, AI and DL Kernel Libraries
NVIDIA
• Innovating and developing new AI systems technologies for efficient inference • Designing, implementing, and optimizing kernels for high impact AI workloads • Designing and implementing extensible abstractions for LLM serving engines • Building efficient just-in-time domain specific compilers and runtimes • Collaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teams • Contributing to open source communities like FlashInfer, vLLM, and SGLang
Job Requirements
- Masters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); PhD are preferred
- 2 + years (academic/ industry) experience with ML/DL systems development preferable
- Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX, etc) and ideally inference engines and runtimes such as vLLM, SGLang, and MLC.
- Strong Python and C/C++ programming skills
- Strong experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, cuTile, Triton, or similar)
Benefits
- equity
- benefits
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Develop and maintain full stack functionality for the ChartCheck application across frontend and backend systems • Design and implement scalable web and cloud-based software solutions using C# and JavaScript technologies • Collaborate with cross-functional teams to create innovative software products for cancer treatment centers • Participate in thoughtful code reviews and contribute to maintaining high software quality standards • Track and manage development work clearly and independently through tickets and project workflows • Support teammates through knowledge sharing, collaboration, and mentorship • Contribute to secure and compliant software development practices within healthcare environments
Senior Software Engineer – AI
Lumin DigitalLumin Digital is a FinTech company whose innovative digital solutions help financial institutions engage their customers and grow. The company has hired in the
• Design and build AI-powered features across Lumin's digital banking platform • Integrate LLMs and AI APIs into production systems with robust prompt engineering, output validation, and safety guardrails • Evaluate AI outputs critically, ensuring accuracy, reliability, and compliance with financial services regulations • Collaborate cross-functionally with product managers, designers, QE engineers, and other teams to deliver end-to-end AI features • Champion security and compliance in AI feature development • Conduct and participate in code reviews, raising the technical bar for AI-related work
• Act as a critical contributor to developing key products from Outschool, participating and demonstrating exemplary proficiency in domain understanding, user empathy, engineering design, system quality, and cross-functional collaboration • Execute true 0-to-1 efforts with an innovative and action-oriented mindset, embracing ambiguity as an opportunity rather than a challenge • Lead Outschool’s AI-native development transformation both as a cross-team lead and as a deep IC who leads by example • Take on people management responsibilities as needed, like day-to-day support, performance management, and career development • Act as a senior engineering leader to shape Outschool’s engineering culture and processes, particularly with an AI angle • Contribute to hiring by helping identify, interview, and onboard strong engineering talent • Participate in stand-ups, sprint planning, retros, production deployments, and on-call rotations
Senior Full-Stack Software Engineer
CourtAvenueWe are industry experts accelerating digital transformation for the world’s most ambitious companies.
• Design, build, and ship production-grade systems end-to-end - frontend, backend, infrastructure, and the operational glue in between - on time, on budget, and at high quality. • Own technical decisions on architecture, cloud topology, observability, deployment, and security for the projects you lead. • Write secure, resilient, well-tested code, and hold the bar on code review for the people you work alongside. • Debug hard problems - production incidents, performance regressions, concurrency bugs, distributed systems weirdness - and write up what you learn so the team gets stronger. • Build prototypes and proofs of concept to learn quickly (hours, not days), validate ideas, and de-risk technical decisions before committing to a direction. • Mentor teammates and serve as the rubber duck for tougher technical problems. Make the people around you better. • Research new technologies and tools and contribute to refining team processes and engineering practices to deliver excellence. • Provide rough effort estimates and technical scope on new opportunities, and occasionally help present technical options to client stakeholders.




