Runpod is pioneering the future of AI and machine learning, offering cutting-edge cloud infrastructure for full-stack AI applications. Founded in 2022, we are a rapidly growing, well-funded company with a remote-first organization spread globally. Our mission is to empower innovators and enterprises to unlock AI's true potential, driving technology and transforming industries. Join us as we shape the future of AI. We are building Cloud services focused on accelerating AI adoption. Whether you're an experienced ML developer training a large language model, or an enthusiast tinkering with stable diffusion, we strive to make GPU compute as seamless and affordable as possible.
Site Reliability Engineer
Location
United States
Posted
1 day ago
Salary
$150K - $200K / year
Seniority
Mid Level
No structured requirement data.
Job Description
Site Reliability Engineer
Runpod
Role Description The Reliability team owns the availability, performance, and operational excellence of Runpod’s global platform. While infrastructure teams build the systems, the Reliability team ensures those systems remain resilient, observable, and scalable under real-world production conditions. This team is responsible for: - Defining and enforcing reliability standards across engineering - Designing incident response processes and improving recovery times - Building observability systems and reliability tooling - Driving SLO adoption and production readiness reviews - Reducing operational toil through automation As a Site Reliability Engineer on the Reliability team, you will focus on ensuring the stability and resilience of Runpod’s distributed platform. You will partner with engineering teams to improve system design, strengthen observability, and prevent incidents before they happen. This role blends software engineering with production operations. You’ll work on reliability frameworks, SLO design, automation, and production hardening, reducing errors and improving performance across different services and infrastructure. This is a high-impact role central to maintaining trust with developers running critical AI workloads on Runpod. Your Impact - Increase platform uptime and reduce incident frequency and duration - Establish and operationalize SLIs/SLOs across services - Improve MTTR through better tooling, automation, and runbooks - Strengthen production readiness standards - Drive long-term systemic reliability improvements You will influence how reliability is defined and measured across Runpod and help build the operational backbone of the company. Responsibilities - Reliability Engineering - Define and implement SLIs/SLOs for critical services - Lead incident response and coordinate cross-team mitigation efforts - Conduct blameless postmortems and ensure corrective actions are completed - Perform production readiness reviews for new services and features - Identify systemic risks and drive preventative improvements - Observability & Monitoring - Design and improve monitoring, alerting, and dashboards (Prometheus, Grafana, etc.) - Improve signal-to-noise ratio in alerts and reduce alert fatigue - Build internal tooling for reliability tracking and reporting - Improve visibility into GPU performance and distributed systems health - Automation & Toil Reduction - Automate recurring operational workflows - Build tools and scripts (Python, Go, Bash) to eliminate manual processes - Improve deployment safety through automation and guardrails - Strengthen CI/CD reliability and release processes - Cross-Functional Reliability Advocacy - Partner with engineering teams to improve system resilience - Provide guidance on fault tolerance, scalability, and failure handling - Contribute to architectural discussions with a reliability-first mindset Qualifications - 5+ years of experience in SRE, Reliability Engineering, or Production Engineering - Strong Linux systems and Networking expertise - Experience managing containerized production systems - Strong understanding of distributed systems and failure modes - Experience defining and managing SLIs/SLOs - Proven incident response and postmortem leadership experience - Strong scripting or programming skills - Experience with monitoring and alerting systems - Excellent written communication skills - Successful completion of a background check Preferred - Experience with GPU infrastructure or AI/ML platforms - Experience improving reliability in high-growth or large scale environments - Familiarity with GPU observability tooling - Experience with Infrastructure as Code - Experience working in startup environments - Experience building internal reliability platforms or frameworks Benefits - The competitive base pay for this position ranges from $150,000- $200,000 USD. - Meaningful equity in a fast-growing company - everyone on the team receives stock options. - Generous medical, dental & vision plans. - Flexible PTO - take the time you need to recharge. - Most roles are remote work first with an inclusive, collaborative teams utilizing Slack as the main form of internal communication. - Join a passionate team on the cutting edge of AI infrastructure.
Related Guides
Related Categories
Related Job Pages
More DevOps Engineer Jobs
DevOps Engineer
MerativeA data and software partner for health and government social services, with tech and expertise to drive real progress.
• Perform product development in accordance with Merge’s methodology and practices; • Perform software module requirement analysis, design, and test design • Prepare software module specifications, designs, test descriptions and estimates • Implement software modules and unit tests as assigned and conduct appropriate module testing • Conduct appropriate verification and validation activities • Detect, report, investigate, and fix product defects as appropriate; • Participate in the review of product engineering artifacts (e.g., specifications, designs, test descriptions, implementations, tests, records, reports, etc) • Design, develop, and recommend next generation platforms for cloud and on-premise deployments • Develop deployment systems for a variety of interdependent applications running on Linux and Kubernetes • Establish and maintain continuous integration and continuous delivery (CI/CD) pipelines to automate the build, test, and deployment of applications • Assist in the preparation and review of product, engineering, and management plans and reports (e.g., program and project plans) as required • Prepare updates to system specifications, designs, test descriptions, hazard analysis, verification and validation test procedures, and related documentation supporting software development to known standards • Mentor team members and peer review product artifacts including requirement specifications, design specifications, code, etc. • Engage actively in design and code reviews of work items completed by the team in conjunction with the Team Lead and/or architect • Interface with customer(s) and Merge staff to gather product requirements, present technical aspects of the product, and understand problems with the product
Senior Site Reliability Engineer
DiscogsThe world's leading music discovery and record collecting platform empowered by a community of obsessed music fans.
• Owning tasks and larger projects from planning to production rollout • Learning new technologies and building expertise with the goal of teaching and mentoring others; mentoring with the goal of force-multiplying through docs and tools • Maintaining organization cloud presence in AWS • Automating and deploying infrastructure configurations using Infrastructure as Code (IAC) • Mentoring engineering squads on Platform best practices for Kubernetes, MySQL, Kafka, and other software development lifecycle areas • Assisting engineering squads with capacity planning, on-call preparation, and production readiness • Writing documentation and runbooks that contribute to the engineering organization’s knowledge base • Implementing monitoring and alerting systems with Discogs observability tools • Working in a containerized, orchestrated environment • Participating in on-call rotation, responding to incidents, and troubleshooting data and other operations issues • Contributing to the reliability and design patterns of our Kafka CDC and event workflows • Contributing to agentic AI best practices and tooling, including skills, agents, and safety
Staff Software Engineer, Dev Ops
CongaConga delivers the most scalable revenue lifecycle management solution to help companies crush operational complexity.
• Serve as a senior technical leader responsible for designing, building, and evolving the infrastructure, automation, and cloud platform capabilities that power Conga’s revenue lifecycle management solutions • Partner closely with Engineering, Product, Security, and Operations teams to establish scalable DevOps practices, accelerate software delivery, and improve platform reliability across our global SaaS ecosystem • Influence architectural decisions, drive modernization initiatives, and champion best practices that improve developer productivity, system scalability, and operational excellence • Help shape the future of our engineering platform by designing highly available cloud infrastructure, advancing automation capabilities, and enabling best-in-class development experiences. • Design, implement, and optimize enterprise-scale CI/CD pipelines that accelerate software delivery • Establish automation strategies that improve deployment consistency, quality, and release velocity • Architect, build, and maintain highly available cloud environments across AWS and Microsoft Azure. • Develop Infrastructure-as-Code solutions using technologies such as Terraform and CloudFormation • Champion Site Reliability Engineering (SRE) principles and reliability-focused engineering practices.
Senior Software Engineer, Dev Ops
CongaConga delivers the most scalable revenue lifecycle management solution to help companies crush operational complexity.
• Design, implement, and maintain scalable CI/CD pipelines that automate software build, testing, deployment, and release processes. • Drive continuous improvement initiatives that increase deployment efficiency, reliability, and developer productivity. • Partner with engineering teams to establish DevOps best practices across the software development lifecycle. • Champion automation-first approaches that reduce manual effort and improve operational consistency. • Design and support highly available, secure, and scalable cloud infrastructure across AWS and Microsoft Azure environments. • Develop and maintain Infrastructure-as-Code (IaC) solutions using tools such as Terraform and CloudFormation. • Optimize platform performance, cost efficiency, and operational resilience across production and non-production environments. • Partner with engineering teams to build and maintain cloud-native architectures that support growth and scale. • Design, deploy, and manage containerized workloads utilizing Docker and Kubernetes. • Establish deployment standards and operational best practices for Kubernetes-based environments. • Support container orchestration, monitoring, scaling, and lifecycle management initiatives. • Drive platform modernization efforts through the adoption of cloud-native technologies. • Implement and maintain infrastructure and application security best practices, including encryption, access controls, network security, and vulnerability management. • Design solutions that support fault tolerance, disaster recovery, and business continuity objectives. • Collaborate with teams to improve observability, monitoring, alerting, and incident response capabilities. • Proactively identify risks and implement solutions that improve system reliability and uptime. • Collaborate with software engineers, architects, and product teams to support scalable application development and deployment strategies. • Provide technical guidance on infrastructure architecture, cloud adoption, and operational best practices. • Participate in architectural reviews and contribute to long-term platform strategy discussions. • Foster a culture of continuous learning, innovation, and engineering excellence.



