Member of Technical Staff, CI/CD Infrastructure

Infrastructure EngineerInfrastructure EngineerFull TimeRemoteLeadTeam 11-50Since 2025H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

$200K - $400K / year

Seniority

Lead

Job Description

Member of Technical Staff, CI/CD Infrastructure

Inferact

Role Description vLLM is growing at a fast pace, and every bit of that growth lands on the CI system. More models, more hardware, more contributors, more ways for things to break. Your job is to make sure none of that slows anyone down. - Maintain and scale the compute infrastructure that powers CI, release, performance benchmark, accuracy evaluation for vLLM project, across a wide range of models and accelerators including H100/H200, (G)B200/300, AMD MI325/355X, TPU, Intel Gaudi, etc. - Get creative about cutting CI time-to-signal from hours to minutes. - Make sure every corner of vLLM code base is well-tested. - Keep vLLM releases rock-solid. - Build out tooling that helps 3,000+ vLLM contributors move fast. Qualifications - Strong experience with Docker, Kubernetes, and containerized build or test environments. - Built CI/CD pipelines from scratch using GitHub Actions, Buildkite, or similar systems. - Familiar with CI design patterns and CI techniques: compute orchestration, handling flaky tests, dependency/environment management, caching, remote execution, test target determination, etc., test coverage, and so on. - Fluent in Python, Bash, Go, or similar for automation and tooling. - Solid fundamentals of Linux, security, networking, storage, package management. Requirements - Bonus points for setting up infrastructure for ML, inference, CUDA, ROCm, or accelerator-heavy workloads. - Running Buildkite at scale, including agents, queues, dynamic pipelines, test sharding, caching, and artifact management. - Operating Kubernetes clusters for CI, batch jobs, test execution, or internal developer infrastructure. - Managing CI/CD in large open-source project. - Building dashboards, alerts, runbooks, or tooling for CI observability. Benefits - Generous health, dental, and vision benefits. - 401(k) company match.

Related Categories

Related Job Pages

More Infrastructure Engineer Jobs

Datavant logo

Cloud Infrastructure Engineer

Datavant

Connecting the world’s health data to improve patient outcomes.

Full TimeRemoteTeam 201-500Since 2017H1B Sponsor

• Automate cloud infrastructure provisioning using Terraform and Ansible, writing IaC that supports Simple, Secure, and Scalable deployments • With an emphasis on networking, directly support platform engineering partners and application development teams in troubleshooting, provisioning and maintaining various enterprise infrastructure • Architect, optimize, and maintain secure network infrastructure in Azure, AWS, & GCP • Configure and manage virtual networks and subnets, including IP addressing, routing, firewall rules, and load balancing • Collaborate with security teams to enforce Zero Trust networking, IAM, and data encryption standards, as well as general security framework adherence • Through IPAM, maintain a network topology that provides for integration testing among development teams while remaining flexible enough to unify additional environments as merger and acquisition requires • Solution and implement Direct Connect, Express Route, and VPN technologies to establish secure, reliable and resilient connections • Work closely with Security and Compliance to ensure security framework adherence (SOC2, Hi-Trust, FEDRAMP etc.) • Provide self-service infrastructure governance and automation for the development teams, enabling them to focus on delivering business value as efficiently as possible

United States
$100K - $130K / year
UJET logo

Senior Cloud Infrastructure Engineer

UJET

Enabling the development of electric vehicles of the future. From #materialscience to ultimate #emobility products.

Full TimeRemoteTeam 51-200H1B Sponsor

• Design and manage GCP project structure, networking, and core infrastructure • Own Kubernetes cluster infrastructure (provisioning, upgrades, scaling, reliability) • Define and maintain infrastructure-as-code (Terraform) standards and patterns • Improve system-level architecture for scalability, resilience, and performance • Build reusable infrastructure patterns that product teams can safely adopt • Reduce friction for developers while maintaining strong guardrails • Partner with engineering teams to improve how services are deployed and operated • Manage and evolve base observability systems (metrics, logging, tracing foundations) • Build and maintain infrastructure for secrets management, IAM, and security primitives • Ensure infrastructure is secure by default, not by exception • Improve infrastructure reliability and reduce systemic risk • Lead and contribute to incident response when infrastructure is involved • Identify and eliminate infrastructure-level failure modes and bottlenecks • Drive cloud cost visibility and optimization • Build systems and practices that balance performance, reliability, and cost • Partner with leadership to align infrastructure investment with business needs • Shape infrastructure strategy across teams and services • Drive adoption of standards and best practices across engineering • Identify systemic issues and lead cross-team improvements.

United States
$150K - $175K / year
NVIDIA logo

Senior GPU and HPC Infrastructure Engineer – DGX Cloud

NVIDIA

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Full TimeRemoteTeam 10,001+Since 1993H1B Sponsor

• Contribute to a platform that automates GPU asset provisioning, configuration, and lifecycle management across cloud providers • Build end-to-end automation of datacenter operations, break/fix, and lifecycle management for large-scale Machine Learning systems • Implement monitoring and health management capabilities that enable reliability, availability, and scalability of GPU assets • Manage NVLINK topography across GPU clusters • Build automated test infrastructure to qualify distributed systems for operation • Collaborate with engineering teams to ensure software integration from hardware to AI training applications

California
$184K - $356.5K / year
CrowdStrike logo

Senior AI Infrastructure Engineer, LLM/AI Platforms

CrowdStrike

CrowdStrike has redefined security with the world’s most advanced cloud-native platform that protects and enables the people, processes and technologies that drive modern enterprise. Tested and proven, the world's largest organizations trust CrowdStrike to stop breaches with unparalleled protection against the most sophisticated cyberattacks. The CrowdStrike culture has been built upon our Core Values since the day we began. We are Fanatical About the Customer, Relentlessly Focused on Innovation and believe that our Limitless Passion drives Unlimited Potential for every CrowdStriker. As a purpose-built remote-first company, we believe cultivating a connected culture for every employee, no matter where they are in the world, is a key ingredient in building a high-performing, diverse team. We don’t have a mission statement. We’re on a mission—to stop breaches. Ready to join a mission that matters?

Full TimeRemoteTeam 5,001-10,000Since 2011H1B Sponsor

• Provision and configure large GPU clusters and compute resources for LLM training, finetuning, and inference workloads. • Develop and optimize LLM model-serving infrastructure, including deployment and optimization of various inference frameworks. • Lead model lifecycle management including versioning, checkpointing and reproducibility across training and inference deployments. • Design and champion robust evaluation frameworks to assess model performance, accuracy, and reliability, ensuring AI systems are consistently at production-ready standards. • Identify and address GPU utilization and GPU memory efficiency bottlenecks and apply techniques like quantization, batching, and caching. • Architect and maintain data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented Generation (RAG), and AI Agentic Systems at scale. • Deliver production-ready code with a focus on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising quality. • Apply expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads. • Define and enforce best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and zero-touch recovery mechanisms for AI services. • Document architectural designs thoroughly and communicate technical decisions clearly to stakeholders. • Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to transform research prototypes into robust, production-grade services.

United States
$140K - $215K / year