NVIDIA logo
NVIDIA

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Senior GPU and HPC Infrastructure Engineer – DGX Cloud

Infrastructure EngineerInfrastructure EngineerFull TimeRemoteSeniorTeam 10,001+Since 1993H1B SponsorCompany SiteLinkedIn

Location

California

Posted

3 days ago

Salary

$184K - $356.5K / year

Seniority

Senior

Bachelor Degree10 yrs expEnglishCloudDistributed SystemsKubernetesLinuxPythonGo

Job Description

Senior GPU and HPC Infrastructure Engineer – DGX Cloud

NVIDIA

• Contribute to a platform that automates GPU asset provisioning, configuration, and lifecycle management across cloud providers • Build end-to-end automation of datacenter operations, break/fix, and lifecycle management for large-scale Machine Learning systems • Implement monitoring and health management capabilities that enable reliability, availability, and scalability of GPU assets • Manage NVLINK topography across GPU clusters • Build automated test infrastructure to qualify distributed systems for operation • Collaborate with engineering teams to ensure software integration from hardware to AI training applications

Job Requirements

  • 10+ years of software engineering experience on large-scale production systems
  • BS in Computer Science/Engineering/Physics/Mathematics or other comparable Degree or equivalent experience
  • Expert level knowledge of a systems programming language (Go, Python)
  • Expert level knowledge of Linux system administration and management
  • Understanding of cluster management systems (Kubernetes, SLURM)
  • Understanding of performance, security and reliability in complex distributed systems
  • Familiarity with system level architecture, data synchronization, fault tolerance and state management

Benefits

  • Eligible for equity and benefits

Related Categories

Related Job Pages

More Infrastructure Engineer Jobs

CrowdStrike logo

Senior AI Infrastructure Engineer, LLM/AI Platforms

CrowdStrike

CrowdStrike has redefined security with the world’s most advanced cloud-native platform that protects and enables the people, processes and technologies that drive modern enterprise. Tested and proven, the world's largest organizations trust CrowdStrike to stop breaches with unparalleled protection against the most sophisticated cyberattacks. The CrowdStrike culture has been built upon our Core Values since the day we began. We are Fanatical About the Customer, Relentlessly Focused on Innovation and believe that our Limitless Passion drives Unlimited Potential for every CrowdStriker. As a purpose-built remote-first company, we believe cultivating a connected culture for every employee, no matter where they are in the world, is a key ingredient in building a high-performing, diverse team. We don’t have a mission statement. We’re on a mission—to stop breaches. Ready to join a mission that matters?

Full TimeRemoteTeam 5,001-10,000Since 2011H1B Sponsor

• Provision and configure large GPU clusters and compute resources for LLM training, finetuning, and inference workloads. • Develop and optimize LLM model-serving infrastructure, including deployment and optimization of various inference frameworks. • Lead model lifecycle management including versioning, checkpointing and reproducibility across training and inference deployments. • Design and champion robust evaluation frameworks to assess model performance, accuracy, and reliability, ensuring AI systems are consistently at production-ready standards. • Identify and address GPU utilization and GPU memory efficiency bottlenecks and apply techniques like quantization, batching, and caching. • Architect and maintain data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented Generation (RAG), and AI Agentic Systems at scale. • Deliver production-ready code with a focus on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising quality. • Apply expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads. • Define and enforce best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and zero-touch recovery mechanisms for AI services. • Document architectural designs thoroughly and communicate technical decisions clearly to stakeholders. • Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to transform research prototypes into robust, production-grade services.

United States
$140K - $215K / year
ioasys logo

Cloud Infrastructure Architect

ioasys

We build unique experiences for bold companies.

Full TimeRemoteTeam 201-500Since 2012H1B No Sponsor

• Design, develop and evolve solution architectures in cloud environments (AWS and Azure); • Work hands-on in the implementation and maintenance of solutions across multiple projects; • Model and document technical architectures, ensuring standardization and governance; • Support development and infrastructure teams in building scalable and secure solutions; • Provide technical leadership for architecture initiatives and support technical decision-making; • Develop and support DevOps strategies, CI/CD processes and infrastructure automation; • Build and support integrations between systems and APIs; • Work with Linux and Windows environments in corporate contexts; • Support architecture definitions oriented to microservices and application modularization; • Participate in agile team ceremonies and routines, contributing technical guidance; • Collaborate with multidisciplinary teams to understand technical and business requirements; • Propose continuous improvements to processes, tools and architectures; • Ensure best practices for security, availability, performance and observability of solutions; • Share technical knowledge and support the development of team members; • Assist in defining architectural standards and best practices for development and infrastructure.

Brazil

Role Description We're looking for an experienced IT & Infrastructure Lead to build, own, and continuously evolve Birg's shared technology function. This isn't a traditional IT support role. You'll be responsible for the technology foundation that enables every Birg company to operate securely and efficiently—from cloud infrastructure and cybersecurity to business systems, access management, disaster recovery, and technology governance. You'll work across the organization, partnering with People & Culture, Operations, Finance, Legal, Engineering, and our portfolio companies to ensure our technology environment remains secure, scalable, and aligned with the needs of a growing venture portfolio. If you're passionate about building systems from the ground up, strengthening operational maturity, and creating technology environments that help businesses scale, we'd love to meet you. What You'll Do - Technology Operations - Lead Birg's day-to-day IT operations and support function. - Own incident management, service requests, and issue resolution. - Monitor system health, availability, and operational performance. - Coordinate with internal teams and external vendors to resolve technical issues. - Maintain operational procedures, documentation, and service standards. - Continuously improve IT processes and service delivery. - Infrastructure & Cloud - Administer and maintain Birg's cloud infrastructure, servers, hosting environments, and shared technology platforms. - Provision, configure, and decommission infrastructure resources. - Manage networking, DNS, VPNs, SSL certificates, firewalls, and core infrastructure services. - Coordinate infrastructure deployments, upgrades, maintenance windows, and change management. - Monitor infrastructure performance, scalability, resilience, and operating costs. - Maintain infrastructure documentation, architecture diagrams, configuration standards, and technology inventories. - Partner with engineering teams and external providers to maintain a secure, resilient, and scalable technology platform. - Cybersecurity & Identity Management - Maintain and strengthen Birg's cybersecurity posture. - Implement and maintain security controls across systems and infrastructure. - Monitor vulnerabilities and coordinate remediation activities. - Deploy security patches and infrastructure hardening initiatives. - Manage endpoint security and device compliance. - Design and maintain role-based access controls (RBAC). - Provision and deprovision user access across business systems. - Conduct recurring access reviews and privileged access audits. - Enforce authentication standards, Multi-Factor Authentication (MFA), and security policies. - Promote cybersecurity awareness across the organization. - Business Systems & Technology Governance - Administer Google Workspace, ClickUp, and other shared business applications. - Manage software licensing, subscriptions, renewals, and user provisioning. - Maintain the organization's SaaS ecosystem and technology inventory. - Configure and maintain system integrations. - Evaluate new technology requests and recommend secure, scalable solutions. - Conduct vendor security and technology assessments. - Review technology architecture before adopting new platforms. - Manage operational relationships with technology vendors. - Maintain technology governance standards and documentation. - AI Governance - Maintain Birg's approved AI tools catalogue. - Evaluate AI platforms for security, privacy, and compliance. - Monitor vendor policy updates and emerging technologies. - Support the responsible adoption of AI across the organization. - Develop guidance for secure and effective AI usage. - Business Continuity & Disaster Recovery - Develop and maintain disaster recovery and backup strategies. - Verify backup integrity and recovery readiness. - Conduct scheduled disaster recovery exercises. - Validate Recovery Time Objectives (RTO) and Recovery Point Objectives (RPO). - Coordinate technical recovery during major incidents. - Support business continuity planning across Birg's shared technology environment. - Technology Strategy & Continuous Improvement - Maintain Birg's shared technology architecture. - Identify opportunities to improve operational efficiency through automation and technology. - Recommend infrastructure and platform improvements. - Evaluate emerging technologies that strengthen Birg's operating model. - Ensure technology continues to scale alongside Birg's growing portfolio. What Success Looks Like - Birg's technology infrastructure remains secure, reliable, and scalable. - Critical systems consistently meet availability and service level targets. - Security risks are proactively identified, managed, and remediated. - Identity and access management remains accurate, secure, and compliant. - Business systems reliably support teams across the Birg portfolio. - Disaster recovery and backup capabilities are tested, documented, and ready when needed. - Technology governance enables the organization to adopt new tools confidently and securely. - Birg's technology environment continuously evolves to support the organization's growth and long-term strategy. Work Arrangement This is a long-term independent contractor engagement supporting Birg Holdings' shared technology function. The successful candidate will work closely with Birg's leadership team and support multiple portfolio companies, serving as the primary owner of the organization's shared technology environment. This role requires consistent overlap with Birg's core collaboration hours to ensure effective communication, operational continuity, and timely support across the portfolio. This role is designed for someone who thrives in a fast-paced, high-ownership environment and enjoys building scalable technology foundations that enable multiple businesses to grow securely and efficiently. Qualifications - 6+ years of experience in IT Operations, Infrastructure, Systems Administration, Cloud Engineering, or Technology Management. - Strong knowledge of cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP). - Experience managing Google Workspace, Microsoft 365, or similar enterprise collaboration platforms. - Strong understanding of networking, infrastructure, virtualization, backup solutions, and disaster recovery. - Hands-on experience with cybersecurity best practices, Identity & Access Management (IAM), endpoint security, and vulnerability management. - Experience evaluating SaaS platforms, managing technology vendors, and implementing technology governance processes. - Excellent communication skills with the ability to explain technical concepts to both technical and non-technical stakeholders. - Experience advising senior leadership and supporting multiple business units at once. Nice to Have - Experience building or managing technology environments for startups, scale-ups, venture studios, holding companies, or multi-entity organizations. - Experience within venture studios, startups, private equity, fintech, banking, or holding company environments. - Experience implementing security frameworks such as ISO 27001, NIST, CIS Controls, or similar. - Experience with DevOps practices, Infrastructure as Code (IaC), or cloud automation. - Experience supporting AI platforms and AI governance initiatives. - Professional certifications such as AWS Certified Solutions Architect, Microsoft Azure Administrator, Google Professional Cloud Architect, CISSP, CISM, Security+, ITIL, or equivalent.

Indonesia
DeepSource GmbH logo

Senior Infrastructure, Multi-Cloud Engineer

DeepSource GmbH

Build Artificial Intelligence Talented Teams

ContractRemoteTeam 1-10H1B No Sponsor

• Design, deploy, and maintain infrastructure across GCP and AWS, ensuring high availability, scalability, and cost efficiency • Manage and operate Kubernetes clusters (deployment, scaling, monitoring, troubleshooting) in production environments • Build and maintain CI/CD pipelines and DevOps automation workflows to support development and release cycles • Implement Infrastructure as Code (IaC) practices (e.g., Terraform) for provisioning and configuration management across cloud environments • Manage device and endpoint policies through Microsoft Intune, including compliance policies, configuration profiles, and application deployment • Monitor infrastructure health, performance, and security across cloud and endpoint layers; respond to incidents and perform root cause analysis • Support cloud cost optimization, resource governance, and tagging/organization standards across GCP and AWS • Collaborate with the client's internal IT, security, and DevOps teams to align infrastructure operations with broader organizational policies • Maintain documentation for infrastructure architecture, runbooks, and operational procedures • Participate in on-call/operational support rotations as required by the client (clarify with client if applicable)

Egypt