Runpod logo
Runpod

Runpod is pioneering the future of AI and machine learning, offering cutting-edge cloud infrastructure for full-stack AI applications. Founded in 2022, we are a rapidly growing, well-funded company with a remote-first organization spread globally. Our mission is to empower innovators and enterprises to unlock AI's true potential, driving technology and transforming industries. Join us as we shape the future of AI. We are building Cloud services focused on accelerating AI adoption. Whether you're an experienced ML developer training a large language model, or an enthusiast tinkering with stable diffusion, we strive to make GPU compute as seamless and affordable as possible.

Director of Software Engineering - Product & Platform Delivery

Engineering ManagerEngineering ManagerFull TimeRemoteLeadTeam 80Since 2022

Location

United States

Posted

1 day ago

Salary

$225K - $325K / year

Seniority

Lead

No structured requirement data.

Job Description

Director of Software Engineering - Product & Platform Delivery

Runpod

Role Description We’re looking for a Director of Infrastructure Engineering to lead and scale Runpod’s core cloud and bare-metal environments. This role owns the critical foundational layers of our platform—Site Reliability Engineering (SRE), global networking, High-Performance Computing (HPC) networks, and distributed storage engines. You’ll build the operating rhythm, culture, and technical direction that ensures Runpod remains highly available, performant, and capable of scaling to meet massive GPU computing demands. You will partner tightly with Product Engineering, Product, and GTM leadership to support enterprise customers. Your focus is ensuring that our underlying infrastructure provides the absolute fastest, most reliable, and lowest-latency path for customers training and running large-scale AI workloads. - Own Core Infrastructure & SRE: Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage. Establish rigorous SRE practices, driving SLA/SLO definitions, incident response, observability, and automated remediation. - Architect HPC & Global Networking: Oversee the design, scaling, and operation of Runpod’s global network backbone, as well as ultra-low-latency HPC cluster networks. Drive the implementation and optimization of InfiniBand and RDMA over Converged Ethernet (RoCE) to support massive, multi-node GPU training workloads. - Drive Storage Engine Innovation: Direct the architecture and performance tuning of highly scalable, distributed storage systems. Ensure our storage engines can deliver the massive IOPS and throughput required to keep high-end GPUs fed with data during deep learning tasks. - Build a High-Output Org: Hire, mentor, and grow highly technical engineering managers and senior ICs (network architects, systems engineers, SREs). Create a culture of ownership, operational excellence, and craft in a remote-first environment. - Translate Scale into Strategy: Partner with Program Management and Product to forecast capacity requirements, shape technical roadmaps, and convert massive scale challenges into clear technical scopes, milestones, and measurable outcomes. - Continuously Improve Systems & Flow: Drive measurable improvements in infrastructure reliability and delivery metrics, such as deployment frequency, MTTR (Mean Time To Recovery), infrastructure as code (IaC) coverage, and system uptime. - Architectural Stewardship: Provide architectural oversight for bare-metal provisioning, virtualization layers, network fabrics, and storage clusters, ensuring seamless scalability without becoming a bottleneck for your teams. - Cross-Functional Partnership: Coordinate cleanly with product delivery and platform teams to ensure the infrastructure primitives they rely on are robust, well-documented, and highly available. Qualifications - 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads, with a proven record of scaling high-availability cloud environments. - 8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms. - Proven hands-on background or strong architectural understanding of ultra-low latency networking. Deep familiarity with InfiniBand and/or RoCE, spine-leaf architectures, and global WAN routing protocols (BGP). - Experience building, operating, or tuning high-performance distributed storage systems and parallel file systems (e.g., Ceph, Lustre, Weka, NVMe-oF) capable of handling heavy AI/ML I/O loads. - Strong foundation in reliability engineering, infrastructure-as-code (Terraform, Ansible), container orchestration (Kubernetes), and modern observability stacks. - Experience building culture, accountability, and momentum across distributed technical teams. - Clear written and verbal communication, strong stakeholder management, and calm, decisive leadership during high-stakes operational incidents. - Successful completion of a background check. Preferred Qualifications - Direct experience architecting and operating infrastructure specifically optimized for massive GPU clusters and AI/ML workloads. - Deep understanding of hardware architectures, GPU interconnects (NVLink), and datacenter topology. - Track record of scaling infrastructure teams in hyper-growth startup environments. - Open-source contributions or active recognition within the infrastructure, networking, or Kubernetes communities. Benefits - The competitive base pay for this position ranges from ($225,000 - $325,000). This salary range may be inclusive of several career levels at Runpod and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location. - Meaningful equity in a fast-growing company - everyone on the team receives stock options — your impact drives our growth, and you share in the upside. - Generous medical, dental & vision plans. - Flexible PTO - take the time you need to recharge. - Most roles are remote work first with an inclusive, collaborative teams utilizing Slack as the main form of internal communication. - $1,200 Home Office & Equipment Stipend - We set you up for success from day one with gear and support to create your ideal workspace.

Related Categories

Related Job Pages

More Engineering Manager Jobs

MongoDB logo

Engineering Manager, Query Integration

MongoDB

MongoDB, originally called 10gen, is a software development company. Since 2007, MongoDB has created an open-source, document-oriented database to help clients

Full TimeRemoteTeam 5,550Since 2008

Join the MongoDB Server Query team, and help us build a world-class distributed open source query engine. Our team plays a crucial role in the experience and performance of data processing. We are responsible for the MongoDB Query Language and the lifecycle of each query, from parsing to optimization to plan selection and execution. Also included are user-facing features that integrate into the query engine, such as full-text search, vector search, and workload observability. Our global team is growing fast, and we are looking for people leaders as part of this expansion. We support office-based as well as remote work, and align projects with convenient work hours for each time-zone. We have tons of interesting problems to solve with direct impact on users for transactional, time-series, and analytical workloads. As we grow, we need engineering managers to help us structure the organization, improve technical processes, provide career mentorship, guide the product roadmap, and manage projects. This role can be based out of our New York City office, Austin office, Palo Alto office, or San Francisco Office or remotely in the US. Candidate Profile - Experience building production-level code with a large user base, robust design structure, and rigorous code quality - Degree in Computer Science or similar field, or equivalent practical experience, with strong competencies in data structures, algorithms, and software design/architecture - Proficient in C++ or a similar programming language - Experience managing small engineering teams - Passionate about running teams, mentorship, and coaching Position Expectations - Manage a team of software engineers, responsible for ensuring their success, aiding their career growth, and facilitating their technical work - Makes coding contributions to the team’s projects as needed - Provides feedback on the architecture of the system and the design of new features - Ensures that the team is running smoothly by helping to eliminate technical barriers, coordinating with other teams regarding dependencies, and focusing on the overall happiness of the team - Contributes to planning for organizational growth, including allocation of engineering resources, future hiring plans, and assignment of projects - Sets team culture by example - Estimates the delivery timeline for projects, and communicates well with upper management regarding project execution Success Measures - In three months - You meet regularly with all of your team members and are starting to learn their interests, strengths, and areas for development - You’ll have contributed to a project slated for the next major version of the MongoDB server, as well as fixed a few bugs in a minor version of our latest stable release series - In six months - You participate in code and design reviews for new features - You have identified any skillset gaps in team execution and are helping to fill them - You have worked with each team member to develop a growth plan tailored to their career goals - In twelve months - You’re team has established a track record of delivering new features - You have a clear understanding of the longer term roadmap and have integrated a plan to accomplish it with your team at MongoDB - You have established your role as a leader in the organization such that team members naturally go to you for guidance About MongoDBMongoDB is built for change, empowering our customers and our people to innovate at the speed of the market. We have redefined the data platform for the AI era, enabling builders to create, transform, and disrupt industries with software. MongoDB’s unified data platform, the most widely available, globally distributed data platform on the market, helps organizations modernize legacy workloads, embrace innovation, and unleash AI. Our cloud-native platform, MongoDB Atlas, is the only globally distributed, multi-cloud data platform and is available across AWS, Google Cloud, and Microsoft Azure. With offices worldwide and over 67,000 customers, including 75% of the Fortune 100 and AI-native startups, relying on MongoDB for their most important applications, we’re powering the next era of software. Our compass at MongoDB is our Leadership Commitment, guiding how and why we make decisions, show up for each other, and win. It’s what makes us MongoDB. To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity groups, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys. Learn more about what it’s like to work at MongoDB, and help us make an impact on the world! MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter. MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Req ID: 2273488725 MongoDB’s base salary range for this role is posted below. Compensation at the time of offer is unique to each candidate and based on a variety of factors such as skill set, experience, qualifications, and work location. Salary is one part of MongoDB’s total compensation and benefits package. Other benefits for eligible employees may include: equity, participation in the employee stock purchase program, flexible paid time off, 20 weeks fully-paid gender-neutral parental leave, fertility and adoption assistance, 401(k) plan, mental health counseling, access to transgender-inclusive health insurance coverage, and health benefits offerings. Please note, the base salary range listed below and the benefits in this paragraph are only applicable to U.S.-based candidates. MongoDB’s base salary range for this role in the U.S. is: $137,000—$270,000 USD

Texas + 2 moreAll locations: Texas | New York | California
$137K - $270K / year
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Own end-to-end delivery and execution across cross-functional teams within your product area, ensuring predictable and high-quality outcomes. • Evaluate business and product requirements for technical feasibility and architectural alignment, translating them into well-defined EPICs and technical user stories. • Partner closely with Product Managers, UX Designers, and Engineers to continuously refine, groom, and prioritize the backlog. • Plan and drive sprint execution with clearly defined goals, using project planning tools to establish timelines, delivery milestones, and surface dependencies early. • Champion engineering processes and rituals that enable strong collaboration, accountability, and team efficiency. • Monitor team velocity and capacity to optimize resource allocation, proactively balancing bandwidth against delivery commitments. • Coordinate cross-team dependencies and stakeholder alignment to remove bottlenecks and maintain smooth execution. • Stay hands-on in critical initiatives by guiding design decisions, enforcing sound design patterns, and participating in code reviews to maintain high engineering quality. • Ensure robust monitoring, alerting, and observability for all owned services, consistently meeting defined SLIs and SLOs. • Partner with Product Managers to define, track, and publish post-release product metrics, driving transparency and continuous improvement.

Poland
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

• Hire, retain, manage, mentor, inspire and enable a team of software engineers and QA engineers to achieve maximum productivity. • Create an environment where creative engineering team members find joy shipping business value daily. • Foster a culture of collaboration, innovation, and continuous learning within the team. • Focus on understanding the full team lean value stream and manage and monitor performance and waste within that value stream. • Identify and implement improvements in workflows, tools, and processes to enhance team productivity by promoting lean development methodologies to maximize efficiency and minimize waste. • Partner with Staff Engineers and Product Management to come up with realistic design proposals and development schedule. Break down a large body of work into multiple phases of development tasks. • Partner with Product Management to develop a lean backlog that matches senior leadership expectations for daily release and small story size. • Build skillsets within the team through partnership with Engineering Enablement teams and assure team members have the skills and tools necessary to achieve their team mission. • Accurately assess each engineer’s capability and capacity, set clear goals and expectations while providing regular feedback and performance reviews. • Exercise judgment in evaluating business urgencies and priorities, adjust team resources to achieve better results. • Oversee the design, development, testing, and deployment of e-commerce platform features and enhancements. • Perform other duties and responsibilities as assigned in support of organizational priorities.

Illinois
$142.5K - $178.1K / year
Full TimeRemoteTeam 5,001-10,000H1B Sponsor

• Lead the Communications, Data & Industrial business lines through design services and project estimating for construction and major improvements to critical infrastructure elements • Develop and implement design engineering and estimating processes and work management structures that are repeatable, scalable, and support positive client outcomes • Ensure Estimators use best practices, standards, and procedures to determine the cost of a service or product • Manage, coach, and develop estimating resources to ensure tracking and delivery of project estimates in an accurate and consistent manner • Develop and implement strategic pricing methodology in collaboration with Service Operations and Sales leadership • Develop, implement, manage & maintain estimating tools • Collaborate with internal resources to ensure the most current cost structure is maintained • Develop and maintain cost history on all project scopes • Advise and assist in identifying risks and developing mitigation strategies for project bids • Lead creation of detailed installation specifications that meet client standards and requirements • Is a Subject Matter Expert on client playbooks • Develop procedure to ensure only the current versions of client playbooks and requirements are referenced • Analyze standards, construction drawings, project plans, and site survey data to gain a thorough understanding of projects • Review Project bids and estimates accuracy and cost discrepancies • Attend pre-bid meetings and/or tour job sites to confirm necessary take-offs • Interface with clients on bid-walks and via conference calls • Present technical and complex information in a simplified manner to different stakeholders • Drive a positive work environment by providing leadership, direction, mentorship and motivation to team members • Grow, develop, and lead a winning team through effective performance management, hiring, training, and retention • All other duties as assigned by manager

Arizona + 3 moreAll locations: Arizona | Pennsylvania | Texas | Washington
$91.6K - $114.5K / year