Senior Software Engineer, Compute Platform
Location
Illinois
Posted
83 days ago
Salary
$165K - $225K / year
Seniority
Senior
Job Description
Senior Software Engineer, Compute Platform
Moonlite
• Design and build scalable compute orchestration platforms that manage GPU clusters, bare-metal server provisioning, and resource allocation across co-located infrastructure environments. • Implement intelligent workload scheduling, resource allocation, and optimization algorithms that maximize GPU utilization while maintaining performance guarantees for research and training workloads. • Design and implement systems for provisioning and managing research computing environments including Kubernetes and SLURM clusters, enabling automated deployment, resource scheduling, and workload orchestration for distributed AI training and HPC workloads. • Develop platform capabilities for managing latest-generation NVIDIA GPU configurations (H100, H200, B200, B300), including GPU resource management, multi-tenant isolation, and integration with compute orchestration systems. • Build automation and tooling for complete bare-metal server lifecycle management – from initial provisioning and configuration through ongoing operations, updates, and resource reallocation. • Optimize compute platform components for high-throughput and low-latency performance, ensuring research workloads achieve near-bare-metal efficiency in virtualized or containersized environments. • Develop robust APIs and SDKs that enable researchers to programmatically provision and manage compute resources, integrating seamlessly with existing workflows and research infrastructure. • Implement comprehensive monitoring and telemetry systems for compute resources, providing visibility into GPU virtualization, workload performance and infrastructure health. • Build enterprise-grade multi-tenant compute isolation, security boundaries, and resource quotas that enable safe sharing of GPU infrastructure across teams and organizations.
Job Requirements
- 5+ years in software engineering with proven experience building compute platforms, container orchestration systems, or distributed compute infrastructure for production environments.
- Strong background in building compute orchestration, resource scheduling, or workload management systems at scale.
- Strong familiarity with Kubernetes architecture, container orchestration concepts, and experience deploying workloads in Kubernetes environments. Understanding of pods, deployments, services, and basic Kubernetes operations.
- Experience with Go, C/C++, Python, or Rust for performance-critical components is highly valued.
- Strong experience with Linux in production environments, including systems for programming, performance optimization, and low-level resource management.
- Deep knowledge of virtualization technologies (KVM, Xen), container runtimes, and orchestration platforms.
- Understanding of GPU architectures, CUDA programming (where/when needed), and GPU resource management – or a strong ability to learn quickly.
- Experience with bare-metal provisioning, out-of-band management systems, and hardware abstraction layers.
- Demonstrated ability to solve complex performance and scalability challenges while balancing pragmatic shipping with good long-term architecture.
- Comfortable navigating ambiguity, defining requirements collaboratively, and communicating technical discussions through clear documentation.
- Growth mindset with continuous focus on learning and professional development.
Benefits
- 6% 401(k) match
- Fully covered health insurance premiums
- Other comprehensive offerings to support well-being and success
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
• Develop independent microservices that solve domain-specific problems (users, vehicles, debts, payments, etc.). • Responsible for the entire code development lifecycle, from planning with the product team (pre-code) through production deployment and monitoring its impacts (post-code). • Troubleshoot and contribute to the challenges of the technology and product teams by sharing ideas, solutions, code, architectures, etc. • Improve the software development experience within the company, including tools, test coverage, code structure, and more. • Actively participate in software design discussions and decisions, taking the lead and helping to create documentation. • Create scalable, sustainable, and user-focused solutions. We use technologies such as Node.js, Python, React Native, Flutter, and PostgreSQL. You don’t need prior experience with all of them, but you should be open to learning them. • Help structure the software architecture to harmoniously orchestrate our services.
• Delegate tasks and assignments to the technical team, providing the necessary support for them to grow quickly from a technical perspective and become high-performing • Conduct regular 1:1 meetings with your technical team • Develop independent microservices that solve domain-specific problems (user, vehicle, debts, payments, etc.) • Responsible for the entire code development lifecycle, from planning together with the product team (pre-code) to deploying to production and monitoring the impact (post-code) • Lead problem resolution and actively contribute to the challenges of the technology and product teams, sharing ideas, solutions, code, architectures, etc. • Improve the software development experience at Gringo, considering tools, test coverage, code structure, etc. • Actively participate in software design discussions and decisions. Take the lead and help create documentation • Build scalable, sustainable, and user-focused solutions. We use technologies such as Python, Node.js, React, PostgreSQL. You don’t need to know all of these technologies, but you should be open to learning them • Help organize the software architecture to harmoniously orchestrate our service architecture • Conduct security and structural audits to identify opportunities for improvement.
• Build user interfaces and backend APIs for all parts of Teleport • Work on the full product lifecycle from ideation to deployment • Collaborate with customers to understand their problems • Write RFDs for proposed designs, implement, test, and document
• Build native mobile applications (starting with iOS) • Contribute to backend APIs and integrations for all parts of Teleport • Work on the full product lifecycle from working with customers to understand their problems, writing RFDs for your proposed design, implementation, testing, and documentation.


