Principal Developer, AI Networking

Software EngineerSoftware EngineerFull TimeRemoteLeadTeam 10,001+Since 1993H1B SponsorCompany SiteLinkedIn

Location

California + 3 moreAll locations: California | Colorado | Texas | Washington

Posted

20 hours ago

Salary

$272K - $431.3K / year

Seniority

Lead

Bachelor Degree15 yrs expEnglishDistributed SystemsPythonPyTorchTensorflow

Job Description

Principal Developer, AI Networking

NVIDIA

• Characterizing AI workloads and deep learning models aimed at large-scale LLM training and inference on NVIDIA supercomputers. • The role centers on distributed systems with a focus on high-performance networking and NVIDIA communication libraries. • Benchmarking, profiling, and analyzing the performance to find bottlenecks and identify areas for improvement and optimizations, with a strong emphasis on networking aspects. • Developing PyTorch trace-based profiling, analysis, and replaying toolset to aid in benchmarking, debugging, and co-designing network systems for LLM workloads. • Collaborating with multiple teams from hardware to software to provide performance analysis insights. • Defining performance test plans, setting performance expectations for new technologies and solutions, and working to achieve performance targets.

Job Requirements

  • B.Sc in Computer Science or Software Engineering or equivalent experience.
  • 15+ years of experience with high-performance networking (RDMA, MPI, NCCL, SHARP).
  • Demonstrated ability in performance evaluation techniques and approaches.
  • Experience with NVIDIA GPUs and the CUDA library.
  • Knowledge of deep learning frameworks like TensorFlow or PyTorch.
  • Expertise in networking collective communication libraries such as NCCL and protocols like RoCE and RDMA.
  • Fast and self-learning capabilities with strong analytical and problem-solving skills.
  • Proficiency in programming languages: Python, Bash, and C++.
  • Experience with a container-based development environment.
  • Great teammate who communicates clearly and works well with others.

Benefits

  • equity
  • benefits

Related Job Pages

More Software Engineer Jobs

Sur Global logo

Front-End Developer

Sur Global

We don’t just partner with you, we accelerate your progress and fuel your growth.

Software Engineer20 hours ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

• Develop and maintain frontend features using React and TypeScript. • Build modern, performant, and scalable user interfaces. • Integrate frontend applications with REST APIs. • Collaborate with backend, product, and design teams. • Contribute to frontend architecture, code quality, testing, performance, and usability improvements.

Brazil
$2.2K - $3.2K / month
Collabora logo

Engineering Lead – Fixed Term 12 Month Contract

Collabora

Open Source, tailored for you. Whether it's the Linux kernel, web engines, graphics or multimedia, we can help.

Software Engineer21 hours ago
Full TimeRemoteTeam 51-200Since 2005H1B No Sponsor

• Build strong, trusting relationships with engineers across multiple time zones and cultures • Lead effective one-on-one and team meetings, balancing facilitation with real-time note-taking and follow-up actions • Set and reinforce clear expectations of the engineering role, ensuring alignment, fairness, and transparency • Drive the full performance management cycle by guiding teams through development planning, tracking and discussing progress against objectives, on a timely and constructive manner. • Manage performance, monitor challenges and issues, provide support and conduct appraisals as per company’s guidelines • Support and encourage individual growth and performance • Navigate sensitive or challenging conversations with professionalism, emotional intelligence, and an open mind • Support engineers through conflict, blockers, and personal or professional challenges with empathy and discretion • Collaborate closely with internal stakeholders to maintain strong communication channels and ensure alignment on organisational goals • Guide the team through organisational transitions, provide stability and maintain morale during periods of uncertainty • Maintain team engagement and productivity during change. • Help shape and champion a culture of openness, accountability, and respect

United Kingdom
Sony logo

Senior Software Engineer

Sony

Sony Interactive Entertainment (SIE) is a leading global source for digital and interactive game systems, games, and products. It is the parent company behind t

Software Engineer21 hours ago

Title: Senior Software Engineer Location: United Kingdom, Liverpool Category: PD Tools & Services Job Description: Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. ROLE OVERVIEW As a Senior Software Engineer, you will create tools used by engineers, QA specialists, production teams, and studio partners around the world. You will remove friction from game development workflows and turn user feedback into reliable, high-quality software. This role suits someone who enjoys practical engineering challenges, has an interest in games and tools development, and wants to see their work make a visible difference. You will work independently, contribute to technical direction, and may lead a small project or a significant part of a larger one. We value pragmatic engineers who can make thoughtful trade-offs between quality, speed, maintainability, and long-term technical health.# Ideally, we would like someone to be present in our Liverpool office 2-3 days a week, but we can be flexible with remote working for the right candidate. WHAT YOU’LL BE DOING: - Design, develop, maintain, and improve tools, services, and pipelines. - Own delivery from analysis and design through development, testing, release, support, and iteration. - Contribute to technical design, including architecture trade-offs, APIs, reliability, security, testing, and operational support. - Refactor and optimise systems to reduce technical debt and improve performance, maintainability, reliability, and customer experience. - Write high-quality code, automated tests, documentation, and operational guidance. - Improve engineering standards through code reviews, CI/CD, testing, release processes, and shared patterns. - Partner with studios and cross-functional teams to clarify needs, troubleshoot issues, support onboarding, and gather feedback. WHAT WE ARE LOOKING FOR: - Demonstrated senior-level experience in relevant languages such as C++, C#, or similar. - Strong understanding of software design, debugging, automated testing, source control, CI/CD, observability, and maintainability. - Able to debug complex issues across code, systems, environments, integrations, and user workflows. - Able to make thoughtful trade-offs between delivery speed, quality, reliability, complexity, and customer value. - Able to explain technical details clearly to technical and non-technical audiences. - Communicates clearly across time zones, disciplines, and levels of technical knowledge. - Asks questions to understand root causes, customer needs, risks, and intended outcomes. - Works through ambiguity constructively, focusing on shared goals and strong relationships. - Applies pragmatic judgement, choosing approaches that fit the problem rather than following process or preference for its own sake. - Supports and guides engineers, testers, tool users, and partner teams through reviews, pairing, workshops, and documentation. - Looks beyond their own area to identify bottlenecks, improve practices, and support wider outcomes. - Keeps learning, shares knowledge, and brings curiosity and care to the craft of building great software. NICE TO HAVE: - Understanding of how to safely and effectively use generative AI to augment development work. - Experience developing Windows applications within the games industry or building tools that support game dev workflows. - Degree in Computer Science, Software Engineering, or equivalent. Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks. Please refer to our Candidate Privacy Notice for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights. Equal Opportunity Statement: Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category. We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond. Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.

United Kingdom
Sony logo

Senior Software Engineer

Sony

Sony Interactive Entertainment (SIE) is a leading global source for digital and interactive game systems, games, and products. It is the parent company behind t

Software Engineer21 hours ago

Title: Senior Software Engineer Location: United Kingdom, London Hybrid Category: PD Tools & Services Job Description: Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. ROLE OVERVIEW As a Senior Software Engineer, you will create tools used by engineers, QA specialists, production teams, and studio partners around the world. You will remove friction from game development workflows and turn user feedback into reliable, high-quality software. This role suits someone who enjoys practical engineering challenges, has an interest in games and tools development, and wants to see their work make a visible difference. You will work independently, contribute to technical direction, and may lead a small project or a significant part of a larger one. We value pragmatic engineers who can make thoughtful trade-offs between quality, speed, maintainability, and long-term technical health. Ideally, we would like someone to be present in our London office 2-3 days a week, but we can be flexible with remote working for the right candidate. WHAT YOU’LL BE DOING: - Design, develop, maintain, and improve tools, services, and pipelines. - Own delivery from analysis and design through development, testing, release, support, and iteration. - Contribute to technical design, including architecture trade-offs, APIs, reliability, security, testing, and operational support. - Refactor and optimise systems to reduce technical debt and improve performance, maintainability, reliability, and customer experience. - Write high-quality code, automated tests, documentation, and operational guidance. - Improve engineering standards through code reviews, CI/CD, testing, release processes, and shared patterns. - Partner with studios and cross-functional teams to clarify needs, troubleshoot issues, support onboarding, and gather feedback. WHAT WE ARE LOOKING FOR: - Demonstrated senior-level experience in relevant languages such as C++, C#, or similar. - Strong understanding of software design, debugging, automated testing, source control, CI/CD, observability, and maintainability. - Able to debug complex issues across code, systems, environments, integrations, and user workflows. - Able to make thoughtful trade-offs between delivery speed, quality, reliability, complexity, and customer value. - Able to explain technical details clearly to technical and non-technical audiences. - Communicates clearly across time zones, disciplines, and levels of technical knowledge. - Asks questions to understand root causes, customer needs, risks, and intended outcomes. - Works through ambiguity constructively, focusing on shared goals and strong relationships. - Applies pragmatic judgement, choosing approaches that fit the problem rather than following process or preference for its own sake. - Supports and guides engineers, testers, tool users, and partner teams through reviews, pairing, workshops, and documentation. - Looks beyond their own area to identify bottlenecks, improve practices, and support wider outcomes. - Keeps learning, shares knowledge, and brings curiosity and care to the craft of building great software. NICE TO HAVE: - Understanding of how to safely and effectively use generative AI to augment development work. - Experience developing Windows applications within the games industry or building tools that support game dev workflows. - Degree in Computer Science, Software Engineering, or equivalent. Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks. Please refer to our Candidate Privacy Notice for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights. Equal Opportunity Statement: Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category. We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond. Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.

United Kingdom