Runpod is pioneering the future of AI and machine learning, offering cutting-edge cloud infrastructure for full-stack AI applications. Founded in 2022, we are a rapidly growing, well-funded company with a remote-first organization spread globally. Our mission is to empower innovators and enterprises to unlock AI's true potential, driving technology and transforming industries. Join us as we shape the future of AI. We are building Cloud services focused on accelerating AI adoption. Whether you're an experienced ML developer training a large language model, or an enthusiast tinkering with stable diffusion, we strive to make GPU compute as seamless and affordable as possible.
Director of Infrastructure Engineering
Location
United States
Posted
5 hours ago
Salary
$225K - $325K / year
Seniority
Senior
Job Description
Director of Infrastructure Engineering
Runpod
Runpod is the AI Developer Cloud. More than one million developers, from indie researchers to teams running frontier models in production, use Runpod to experiment, train, fine-tune, deploy, and scale AI on one platform. The platform has processed more than 20 billion inference requests. We closed a $100M Series A in June 2026. We're at an inflection point for AI infrastructure, and we're building the platform the next generation of developers will depend on. We're a small, remote-first team. We take ownership seriously, move fast, and ship work that more than a million developers rely on every day. We're looking for people who care deeply, build with urgency, and want to matter at scale. Learn more in our CEO's funding announcement: https://www.runpod.io/blog/one-million-developers. We’re looking for a Director of Infrastructure Engineering to lead and scale Runpod’s core cloud and bare-metal environments. This role owns the critical foundational layers of our platform—Site Reliability Engineering (SRE), global networking, High-Performance Computing (HPC) networks, and distributed storage engines. You’ll build the operating rhythm, culture, and technical direction that ensures Runpod remains highly available, performant, and capable of scaling to meet massive GPU computing demands. You will partner tightly with Product Engineering, Product, and GTM leadership to support enterprise customers. Your focus is ensuring that our underlying infrastructure provides the absolute fastest, most reliable, and lowest-latency path for customers training and running large-scale AI workloads. Responsibilities: - Own Core Infrastructure & SRE: Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage. Establish rigorous SRE practices, driving SLA/SLO definitions, incident response, observability, and automated remediation. - Architect HPC & Global Networking: Oversee the design, scaling, and operation of Runpod’s global network backbone, as well as ultra-low-latency HPC cluster networks. Drive the implementation and optimization of InfiniBand and RDMA over Converged Ethernet (RoCE) to support massive, multi-node GPU training workloads. - Drive Storage Engine Innovation: Direct the architecture and performance tuning of highly scalable, distributed storage systems. Ensure our storage engines can deliver the massive IOPS and throughput required to keep high-end GPUs fed with data during deep learning tasks. - Build a High-Output Org: Hire, mentor, and grow highly technical engineering managers and senior ICs (network architects, systems engineers, SREs). Create a culture of ownership, operational excellence, and craft in a remote-first environment. - Translate Scale into Strategy: Partner with Program Management and Product to forecast capacity requirements, shape technical roadmaps, and convert massive scale challenges into clear technical scopes, milestones, and measurable outcomes. - Continuously Improve Systems & Flow: Drive measurable improvements in infrastructure reliability and delivery metrics, such as deployment frequency, MTTR (Mean Time To Recovery), infrastructure as code (IaC) coverage, and system uptime. - Architectural Stewardship: Provide architectural oversight for bare-metal provisioning, virtualization layers, network fabrics, and storage clusters, ensuring seamless scalability without becoming a bottleneck for your teams. - Cross-Functional Partnership: Coordinate cleanly with product delivery and platform teams to ensure the infrastructure primitives they rely on are robust, well-documented, and highly available. Requirements: - Engineering Leadership Experience: 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads, with a proven record of scaling high-availability cloud environments. - Deep Infrastructure Expertise: 8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms. - HPC & Advanced Networking: Proven hands-on background or strong architectural understanding of ultra-low latency networking. Deep familiarity with InfiniBand and/or RoCE, spine-leaf architectures, and global WAN routing protocols (BGP). - Storage Systems Knowledge: Experience building, operating, or tuning high-performance distributed storage systems and parallel file systems (e.g., Ceph, Lustre, Weka, NVMe-oF) capable of handling heavy AI/ML I/O loads. - SRE / DevOps Culture: Strong foundation in reliability engineering, infrastructure-as-code (Terraform, Ansible), container orchestration (Kubernetes), and modern observability stacks. - Remote-First Operating Excellence: Experience building culture, accountability, and momentum across distributed technical teams. - Communication & Collaboration: Clear written and verbal communication, strong stakeholder management, and calm, decisive leadership during high-stakes operational incidents. - Background Check: Successful completion of a background check. Preferred Qualifications: - Direct experience architecting and operating infrastructure specifically optimized for massive GPU clusters and AI/ML workloads. - Deep understanding of hardware architectures, GPU interconnects (NVLink), and datacenter topology. - Track record of scaling infrastructure teams in hyper-growth startup environments. - Open-source contributions or active recognition within the infrastructure, networking, or Kubernetes communities. What You’ll Receive: - The competitive base pay for this position ranges from ($225,000 - $325,000). This salary range may be inclusive of several career levels at Runpod and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location. - Meaningful equity in a fast-growing company- everyone on the team receives stock options — your impact drives our growth, and you share in the upside. - Generous medical, dental & vision plans. - Flexible PTO- take the time you need to recharge. - Most roles are remote work first with an inclusive, collaborative teams utilizing slack as the main form of internal communication. - Join a passionate team on the cutting edge of AI infrastructure — where culture, learning, and ownership are at the heart of how we scale. - $1,200 Home Office & Equipment Stipend- We set you up for success from day one with gear and support to create your ideal workspace. Runpod is committed to maintaining a workplace free from discrimination and upholding the principles of equality and respect for all individuals. We believe that diversity in all its forms enhances our team. As an equal opportunity employer, Runpod is committed to creating an inclusive workforce at every level. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, protected veteran status, disability status, or any other characteristic protected by law. We welcome every qualified candidate eligible to work in the United States; however, we are currently unable to sponsor employment visas.
Related Guides
Related Job Pages
More Software Engineer Jobs
Role Description Must Have Technical/Functional Skill: - Strong knowledge & Experience in CATIA CAA (Component Application Architecture) - CAA Automation skills of CATIA and ENOVIA - Experience in GUI Development, Webservices and API using CAA V5 - Experience in new API creation using CAA for Java and C++ Clients - Good mechanical design and Geometric Development knowledge is an advantage Roles & Responsibilities: - Develop and expose new APIs in CATIA and ENOVIA V5 using CAA V5 - Ensure adherence to architectural and technical standards - Ensure software quality, effectiveness, performance, and reliability - Participation in peer and formal reviews Qualifications - 6-20 years of experience required Company Description
Enterprise Intelligence Developer
Nemours Children's HealthNemours Children’s Health is an internationally recognized children’s health system. With more than 1.7 million patient encounters annually, we provide medical care in five states through two freestanding state-of-the-art children’s hospitals — Nemours Children’s Hospital, Delaware and Nemours Children’s Hospital, Florida. Our pediatric network includes 80 primary-urgent-and specialty care practices and more than 40 hospitalists serving 19 affiliated hospitals. We generate annual revenues of more than $1.7 billion derived from patient services, contributions from the Alfred I. duPont Trust, as well as other income. We are on a journey to discover better ways of approaching children’s health, focusing on prevention as much as cures. Inclusion and belonging guide our growth and strategy.
Role Description Nemours is seeking an Enterprise Intelligence Developer to join our Nemours Children's Health team. Preferred location is Jacksonville, Florida. Will consider qualified candidates from other remote locations. The Enterprise Intelligence Developer is responsible for the requirements gathering, analysis, development, testing, deployment, monitoring and ongoing support of data extracts, imports, and Data Warehouse transformations and modeling for both business and clinical systems at Nemours. Additionally, this position participates in resolving complex technical issues through debugging, research, and investigation. The position may suggest changes or enhancements to existing products as required to support the business and clinical integration strategy. Essential Functions - Develop and maintain data solutions using Microsoft Fabric, including Lakehouse, SQL Analytics Endpoint, Spark, and OneLake. - Build and enhance data pipelines for ingestion, transformation, and curation of enterprise data. - Contribute to CI/CD implementation for Fabric assets using GitHub, including notebooks, SQL scripts, and deployment workflows. - Support modernization efforts for workloads currently dependent on the on‑prem EDW. - Assist in addressing technical debt resulting from the Clarity Oracle to SQL Server migration. - Collaborate with senior engineers and architects to follow established data engineering standards and best practices. - Support testing, validation, and operational monitoring of Fabric workloads. - Participate in production support and issue resolution as needed to ensure platform reliability. Qualifications - A Bachelor’s Degree or higher in computer science, MIS, or related technical field preferred or equivalent work experience is required. - Minimum of 1 to 3 years of progressively responsible experience in a directly related area, during which both technical and professional capabilities have been clearly demonstrated is required. Minimum of 3 years experience preferred. - Experience with the following preferred: - Hands‑on experience with Microsoft Fabric (Lakehouse, Spark, or SQL Analytics Endpoint). - Familiarity with CI/CD concepts for data platforms. - Experience supporting enterprise analytics or data warehouse environments. - Interest in growing deeper expertise in cloud data engineering and analytics platforms. Company Description Nemours Children's Health is an internationally recognized pediatric health system serving more than 1.7 million patient encounters each year. We deliver care across six states through two freestanding children’s hospitals — Nemours Children's Hospital, Delaware and Nemours Children's Hospital, Florida — along with a network of more than 80 primary, urgent, and specialty care practices and more than 40 hospital partnerships. Backed by the Nemours Foundation and Alfred I. duPont Trust, our $1.7B nonprofit system is dedicated to improving children's health through clinical care, research, education, advocacy, and prevention. Our Whole Child Health approach focuses equally on prevention and treatment, partnering with communities to help every child thrive. Inclusion and belonging guide our strategy and growth. We are committed to culturally relevant care, reducing health disparities, and fostering an environment where every associate, patient, and family feels supported and valued. Learn more at Nemours.org .
Role Description The RealReal Customer Experience team is seeking a kind, curious, and highly collaborative Senior Software Engineer (Full Stack) who enjoys solving complex technical challenges and building exceptional user experiences. Our team is responsible for creating seamless and compelling experiences that make it easy for individuals to consign luxury items with The RealReal. We place a strong emphasis on collaboration, continuous learning, individual growth, and professional development. As a Senior Software Engineer, you will be both a hands-on technical contributor and a key influencer in shaping our engineering direction. You will lead and contribute to significant initiatives, mentor fellow engineers through code reviews and pair programming, and help drive the evolution of our technology platform. We are particularly excited to meet candidates who are passionate about luxury retail, e-commerce, sustainability, and The RealReal's mission of supporting a circular economy for high-end goods. Qualifications - 7+ years of professional software development experience. - Strong proficiency in Java or Kotlin, along with experience working in Ruby on Rails environments. - Expertise in modern JavaScript (ECMAScript), HTML, and CSS. - Experience building applications with React and related ecosystem tools, including Node.js and npm. - Familiarity with RESTful APIs, Git, TypeScript, IDEs, version control systems, and deployment tools. - Understanding of event-driven architectures, GraphQL, and database design fundamentals. - Strong problem-solving skills and a user-centric engineering mindset. - Interest in retail, e-commerce, luxury consignment, sustainability, or circular economy business models. Requirements - Design, develop, and maintain high-quality, scalable, performant, and testable software solutions. - Build and enhance customer-facing applications that directly support strategic company initiatives. - Contribute to technical architecture and engineering decisions that shape the future of our platform. - Collaborate closely with product managers, designers, and engineers to deliver impactful features. - Review pull requests and provide thoughtful, constructive feedback to teammates. - Participate in pair programming and knowledge-sharing activities across the team. - Deploy production-ready code and support applications throughout the software development lifecycle. - Continuously learn and explore new technologies, design patterns, and engineering practices. Benefits - Opportunity to work with a modern technology stack, including Java, Kotlin, TypeScript, GraphQL, Kafka, AWS Lambda, PostgreSQL, and DynamoDB. - Experience with legacy services built with Ruby on Rails, Elixir, and React. What Makes You Successful - You are curious, adaptable, and continuously seek opportunities to learn. - You thrive in collaborative environments and enjoy mentoring fellow engineers. - You balance technical excellence with pragmatic decision-making. - You care deeply about delivering value to users through technology. - You are excited by the opportunity to contribute to a mission-driven organization focused on sustainability and luxury resale.
Role Description Seneca Technologies is seeking an experienced Software Developer to support a program within a federal financial environment. This role focuses on developing, enhancing, and maintaining the Artiva software platform to meet evolving client requirements. The successful candidate will work closely with both technical teams and end users to design and implement solutions that improve workflow performance, system functionality, and overall operational efficiency. A key aspect of this position is collaborating with clients to optimize how Artiva is implemented and utilized, ensuring the platform effectively supports their business processes. - Design, develop, and enhance software solutions within the Artiva platform based on documented business and technical requirements. - Translate functional requirements into scalable and maintainable technical solutions, applying sound development practices and logical problem-solving techniques. - Create detailed solution design documentation for Artiva implementations to support customer understanding, system maintainability, and efficient deployment. - Collaborate directly with clients and stakeholders to optimize Artiva workflows and configurations, identifying opportunities to streamline processes and improve operational efficiency. - Participate in system implementation activities including configuration, integration, and deployment support. - Develop and execute acceptance testing plans, troubleshoot defects, and implement corrective solutions. - Provide technical guidance and support to business users to ensure effective use of Artiva capabilities and features. - Assist in gathering, refining, and documenting client requirements to support new functionality and system enhancements. - Maintain awareness of emerging technologies, development tools, and industry best practices to continuously improve system performance and solution quality. Qualifications - Bachelor’s degree in computer science, Information Systems, or a related technical field. - 5+ years of hands-on software development experience. - U.S. Citizenship with the ability to obtain and maintain required government security clearances. - Demonstrated experience developing or configuring solutions within the Artiva platform. - Ability to communicate technical concepts and solution architecture clearly to both technical and non-technical stakeholders. Requirements - Advanced experience with Artiva workflow design, administration, and scripting language. - Strong experience working with Cache ObjectScript and Cache database environments. - Experience creating and consuming REST and SOAP APIs in Cache. - Experience customizing Artiva Webstation interfaces and functionality. - Strong SQL skills, including query optimization and database design. - Experience with Cache database management and configuration. - Familiarity with Atlassian tools such as Jira, Confluence, and Bitbucket. - Experience with Git version control systems. - Experience with Shell scripting. - Working knowledge of web technologies (HTML, CSS, JavaScript). - Experience working in Agile development environments. - Strong written and verbal communication skills. - Ability to work independently and manage priorities in a fast-paced environment. - Ability to effectively articulate technical requirements and collaborate across technical and business teams. Equal Opportunity Statement Seneca Holdings provides equal employment opportunities to all employees and applicants without regard to race, color, religion, sex/gender, sexual orientation, national origin, age, disability, marital status, genetic information and/or predisposing genetic characteristics, victim of domestic violence status, veteran status, or other protected class status. This policy applies to all terms and conditions of employment, including, but not limited to, hiring, placement, promotion, termination, layoff, recall, transfer, leave of absence, compensation and training. The Company also prohibits retaliation against any employee who exercises his or her rights under applicable anti-discrimination laws. Notwithstanding the foregoing, the Company does give hiring preference to Seneca or Native individuals. Veterans with expertise in these areas are highly encouraged to apply.

