Vultr is on a mission to make high-performance cloud computing easy to use, affordable, and locally accessible.
Senior Manager, AI Infrastructure Operations
Location
United States
Posted
4 days ago
Salary
$150K - $160K / year
Seniority
Senior
Job Description
Senior Manager, AI Infrastructure Operations
Vultr
• Lead the engineering team responsible for the day-to-day implementation, scaling, and operation of AI compute clusters. • Translate engineering roadmaps and technical requirements from the Director of AI Infrastructure into detailed project plans and execution milestones. • Drive delivery of cluster deployments, hardware bring-up, node configuration, and integration with orchestration and scheduling systems. • Ensure cluster reliability, uptime, and performance through monitoring, automation, and continuous operational improvements. • Oversee lifecycle operations for bare metal and GPU fleets, including provisioning, configuration management, firmware/driver updates, and hardware validation. • Manage incident response for GPU and cluster infrastructure, ensuring timely resolution and root-cause analysis. • Work closely with AI/ML, SRE, Networking, and Hardware Engineering teams to ensure cluster capabilities meet training and inference needs. • Coordinate with Product to confirm technical requirements, feature readiness, and delivery timelines. • Support integrations across networking, storage, scheduler, and resource orchestration components. • Improve tooling and automation for cluster provisioning, observability, configuration management, and large-scale fleet operations. • Contribute to the development and refinement of multi-tenant scheduling, workload management, and orchestration systems in partnership with senior technical staff. • Identify performance bottlenecks and propose engineering-level optimizations. • Coach and mentor engineers, fostering a high-performance, detail-oriented engineering culture. • Support career development, expectations, and performance management for team members. • Help refine engineering processes, including code reviews, testing standards, documentation, and operational runbooks.
Job Requirements
- 6–10 years of experience in infrastructure engineering, HPC, large-scale systems, or similar fields
- Strong understanding of AI compute infrastructure, including GPU/CPU clusters, distributed training architectures, and high-performance networking (InfiniBand/RDMA)
- Experience running production bare metal, GPU, or hardware fleet operations at meaningful scale
- Hands-on expertise with Linux systems, Kubernetes or Slurm, provisioning tools (Terraform, Ansible), observability platforms, and networking fundamentals
- Proven track record in cluster operations, hardware bring-up, distributed systems, or ML workload support
- Experience leading engineering teams or pods, with the ability to manage execution while staying close to technical work
- Ability to communicate effectively with cross-functional engineering teams and translate strategy into actionable engineering tasks
- Strong execution mindset with the ability to prioritize, deliver, and adapt in a fast-paced environment.
Benefits
- Excellent Medical Benefits w/ 100% company-paid premiums for employee only plan + 100% company-paid dental & vision premiums
- 401(k) plan that matches 100% up to 4% with immediate vesting
- Professional Development Reimbursement of $2,500 each year
- 11 Holidays + Paid Time Off Accrual + Rollover Plan + take your birthday off
- Increased PTO at 3 year & 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year
- $500 first year remote office setup + $400 each following year for new equipment
- Internet reimbursement up to $75 per month
- Gym membership reimbursement up to $50 per month
- Company-paid Wellable subscription
Related Guides
Related Job Pages
More LLM Engineer Jobs
• You will own, build, and run your startup in fields such as AI Infrastructure • You will embark on an extensive personal development journey crafted by unicorn founders • You will receive support in hiring through our network • You will receive intensive coaching to make your startup ready to raise millions in funding • You will iterate your product until achieving product-market-fit
• You will own, build, and run your startup in fields such as AI Infrastructure. • You will embark on an extensive personal development journey crafted by unicorn founders. • You will receive support in hiring through our network. • You will receive intensive coaching to make your startup ready to raise millions in funding. • You will iterate your product with us until having reached product-market-fit and receive support in building up a sales force or creating a marketing engine respectively.
• You will own, build, and run your startup in fields such as AI Infrastructure. • You will embark on an extensive personal development journey crafted by unicorn founders and follow a fully customised programme enhancing your goal, time, and energy management. • You will receive support in hiring through our network to over 50,000 professionals and advice as well as best practices from serial entrepreneurs. • You will receive intensive coaching to make your startup ready to raise millions in funding. • You will iterate your product with us until having reached product-market-fit and receive support in building up a sales force or creating a marketing engine respectively.
Generative AI Engineer
Weekday (YC W21)We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
• This is a full-time Remote role for a Generative AI Engineer and ML expert. • You can work from home (anywhere in INDIA) and will be responsible for researching and developing our platform with cutting-edge AI agents.
