We build the stage, not the show. We're an infrastructure company, a developer-tools company, and a production partner for model labs, and focus is a deliberate choice we've made and hold to. Day-to-day, that means a small team, a high bar, and real ownership. You won't wait for permission or inherit a backlog of someone else's decisions. In a founding security role, the function is what you make it. It also means ambiguity: priorities shift, not everything is documented. You'll often be the person who decides what "secure enough, for now" means.
Founding ML Infrastructure Engineer
Location
United States
Posted
61 days ago
Salary
$200K - $350K / year
Seniority
Mid Level
Job Description
Founding ML Infrastructure Engineer
uRun
Role Description We are building the next generation of AI inference infrastructure. As our ML Infrastructure and Platform Engineer, you will own the architecture and scaling of our GPU compute platform from the ground up. This is a founding technical hire with end-to-end ownership across the full infrastructure stack, from bare metal to model serving. You will work directly with the founding team and define how we build. What you'll actually be doing day-to-day: - Design and scale our GPU compute platform to support 1,000+ GPU clusters, ensuring high availability and low-latency inference across the fleet. - Build and maintain the infrastructure layer for our compute marketplace, including multi-tenant scheduling, isolation, and billing-aware resource allocation. - Own production reliability for ML systems end-to-end: observability, incident response, and SLA achievement across model serving and infrastructure. - Architect feature stores and model registry systems that support rapid iteration and reproducibility at scale. - Design an experiment tracking infrastructure capable of handling thousands of concurrent runs with full auditability. - Build resource orchestration and scheduling systems that optimise for throughput, cost, and latency across heterogeneous hardware. - Set engineering standards for infrastructure reliability, capacity planning, and operational excellence as an early technical leader. Qualifications - Proven experience designing and operating large-scale distributed infrastructure at 1,000+ nodes or equivalent complexity, in any domain. - Deep expertise in distributed systems, cluster orchestration (Kubernetes, Slurm, or custom schedulers), and large-scale resource scheduling. - Strong production reliability instincts: observability, incident response, capacity planning, and SLA ownership across complex systems. - Experience building infrastructure that other engineers build on top of, not just operating it. - Ability to operate as a technical lead: set direction, make tradeoffs under uncertainty, and raise the bar for the team around you. - Startup orientation. You are energised by ambiguity, move fast, and build for scale from day one. Requirements - Exposure to ML infrastructure concepts: GPU networking (NCCL, InfiniBand, RoCE), model serving frameworks (vLLM, SGLang, TensorRT-LLM), or hardware-aware performance tuning (CuTe, Triton, TileLang). - Experience with multi-cloud GPU procurement and capacity management across AWS, GCP, Azure, and bare metal providers. - Familiarity with inference marketplace architectures, dynamic routing, or spot/preemptible workload management. - Prior experience at a Series A or earlier stage company scaling from early infrastructure to production. Benefits - Competitive salary and meaningful equity in an early-stage AI infrastructure company. The band above is our target; for an exceptional candidate we'll go higher. Equity is real — you're early, and the grant reflects that. - Health, dental, and vision — full coverage. - 401(k) — company-supported retirement savings. - FSA/HSA — flexible spending accounts for healthcare costs. - Paid time off — we trust you to manage your time. - Top-tier tooling — access to the best AI tools available: Claude, Codex, Kimi, and whatever else helps you move faster. - MacBook Pro and AirPods — the hardware you need, on us.
Related Guides
Related Categories
Related Job Pages
More Infrastructure Engineer Jobs
• managing the architecture of a full-stack release management platform, advancing it to accommodate multi-tenant, multi-environment systems across multiple hardware platforms • crafting hierarchical domain models and state machines that manage complex lifecycles and multi-axis promotion flows • architecting robust ingestion and reconciliation pipelines, ensuring data fidelity and compliance across various representations • defining and integrating a comprehensive validation, promotion, and gating model with our automated sanity stages and customer-release pipelines • establishing a strict separation between authoring and production environments, ensuring data integrity and sanitization • setting standards for API build, authentication, RBAC, audit logging, and observability across the platform • leading frontend architecture for a sophisticated authoring and review experience, handling complex tabular editing and bulk operations • driving platform onboarding workflows, defining consistent naming schemes, validation rules, and notification topologies for new hardware platforms • mentoring engineers, conducting architecture reviews, and raising the technical bar across multiple engineering domains • partnering with product, TPM, release managers, and other collaborators to align on roadmaps, capacity, and operational ownership • defining and managing deployment, rollout, and incident-response models, including database migration strategies and clear on-call runbooks and continuously evaluating and incorporating emerging tools, frameworks, and patterns to improve the platform's capabilities.
Trainee - Oracle Cloud Infrastructure
Deutsche Telekom IT SolutionsAs Hungary’s most attractive employer in 2025 (according to Randstad’s representative survey), Deutsche Telekom IT Solutions is a subsidiary of the Deutsche Telekom Group. The company provides a wide portfolio of IT and telecommunications services with more than 5300 employees. We have hundreds of large customers, corporations in Germany and in other European countries. DT-ITS received the Best in Educational Cooperation award from HIPA in 2019, acknowledged as the Most Ethical Multinational Company in 2019. The company continuously develops its four sites in Budapest, Debrecen, Pécs and Szeged and is looking for skilled IT professionals to join its team.
Role Description - Manage and monitor OCI resources (compute, storage, networking) - Provision and maintain cloud infrastructure components - Monitor performance and troubleshoot issues - Implement security policies and access controls - Manage backups, recovery Qualifications - Good English knowledge - Foundational understanding of Oracle Cloud Infrastructure (OCI) - Hands-on experience with Linux-based environment - Nice to have: OCI official certification - Nice to have: Infrastructure as Code tools (e.g Terraform) Requirements - You will be working in the European Union to meet our customers' data security and privacy requirements. - Please be informed that our remote working possibility is only available within Hungary due to European taxation regulation. Company Description As Hungary’s most attractive employer in 2025 (according to Randstad’s representative survey), Deutsche Telekom IT Solutions is a subsidiary of the Deutsche Telekom Group. The company provides a wide portfolio of IT and telecommunications services with more than 5300 employees. We have hundreds of large customers, corporations in Germany and in other European countries. DT-ITS received the Best in Educational Cooperation award from HIPA in 2019, acknowledged as the Most Ethical Multinational Company in 2019. The company continuously develops its four sites in Budapest, Debrecen, Pécs and Szeged and is looking for skilled IT professionals to join its team.
Role Description Conduit's infrastructure team builds systems and tools to enable the Conduit Platform in a reliable, secure, performant, and cost-effective manner. As a senior member of a small, embedded infra team, you'll be instrumental in designing, building, and scaling infrastructure capabilities — and in enabling other engineering teams to ship faster and more reliably. This is a high-ownership, high-autonomy role where you'll have significant influence over how Conduit's infrastructure evolves. Responsibilities - Embed with engineering teams to drive infrastructure design decisions and help bring new products and services from prototype to production. - Define and build internal tooling and processes to enable teams to deploy, migrate, and operate services more reliably and efficiently. - Own large-scope infrastructure projects end-to-end including service migrations, ingress architecture, and internal orchestration and control plane design. - Lead design and implementation of solutions to improve availability, reliability, and security of Conduit services. - Drive sustainable incident response, on-call practices, and retrospectives with a bias toward automation and systemic fixes over manual toil. - Participate in on-call rotation. Qualifications - 5–7+ years of infrastructure or SRE experience, including hands-on experience scaling production systems. - Genuine curiosity about web3 and interest in understanding the products and systems you're supporting. - Strong foundation in system design, distributed systems, and security best practices. - Experience running large-scale Kubernetes infrastructure (100–1,000+ nodes) on a public cloud (AWS, GCP). - Experience designing and supporting highly available and scalable distributed systems. - Strong debugging skills across the stack — networking, performance, memory, and service behavior. - Strong cross-functional collaboration and communication skills. Requirements - Own problems end-to-end and are comfortable navigating ambiguity with limited context. - Are always looking to improve systems rather than simply maintain them; you automate the toil and push toward better reliability, cost, and developer experience. - Can embed with a product team, understand their context quickly, and help them move faster without sacrificing stability. - Like problem solving in a dynamic, collaborative environment with modern cloud tooling. Company Description Conduit is an enterprise-grade blockchain infrastructure and tooling platform powering the next generation of on-chain applications. Our platform supports many of the most notable teams in crypto, with use cases spanning payments, tokenization, and beyond. Built for security, customization, and scalability, Conduit delivers production-grade reliability paired with deep blockchain expertise—so teams can stay focused on what matters most: their product. Backed by a $37M Series A led by Paradigm and Haun Ventures, Conduit is a remote-first company with offices in San Francisco and New York City for those who prefer a hybrid environment. Our team brings experience from companies like Meta, Amazon, Aave, Compound, and Paradigm. We’re building the infrastructure layer that will power on-chain finance for the next decade.
Infrastructure / Network SME
General DynamicsA business unit of General Dynamics, General Dynamics Information Technology (GDIT) supports some of the United States' most complex government, defense, and in
Role Description GDIT is seeking an Infrastructure / Network Subject Matter Expert (SME) to design, modernize, and optimize network and infrastructure solutions supporting large-scale Defense missions. You will serve as a senior technical advisor helping shape resilient, secure, high-performance environments across cloud and on-prem platforms. How You’ll Make an Impact - Design, architect, and optimize enterprise network and infrastructure solutions. - Lead modernization efforts such as cloud migration, network segmentation, and Zero Trust implementation. - Provide troubleshooting expertise for complex networking, routing, and performance challenges. - Work with security teams to ensure compliance with DoD cybersecurity frameworks and accreditation requirements. - Develop architecture diagrams, technical plans, and configuration standards. - Advise leaders and program teams on infrastructure strategy, capacity planning, and lifecycle management. Qualifications - Technical Training, Certification(s) or Degree and 10+ years of experience. - 10+ years deep experience with enterprise networking (routing, switching, firewalls, load balancing). - Strong understanding of cloud networking (AWS, Azure, hybrid architectures). - Hands-on experience with Cisco, Juniper, Palo Alto, F5, or similar technologies. - Familiarity with DoD or federal security frameworks (RMF, STIGs). - Strong troubleshooting and diagnostic skills across network layers. - Ability to communicate complex infrastructure concepts clearly to both technical and non-technical audiences. - US Citizenship Required. - Candidate must possess active SECRET clearance and ability to attain TOP SECRET / SCI. Requirements - CCNP/CCIE, CASP, Network+, or related certifications (Preferred). - Experience supporting large modernization or cloud transformation initiatives (Preferred). - Experience with automation tools (Ansible, Terraform) (Preferred). Benefits - Variety of medical plan options, some with Health Savings Accounts. - Dental plan options and a vision plan. - 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. - Full flex work weeks where possible. - Paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement, and jury duty leave. - 15 days of paid leave per calendar year for new employees, plus 10 paid holidays per year. - Paid Family Leave program providing up to 160 hours of paid leave in a rolling 12 month period for eligible employees. - Short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness, and business travel and accident insurance.


