Role Description As a AI Infrastructure Engineer (SRE) at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase. You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems. Ideally based close to Bangalore or remote India. - Be on an on-call (PagerDuty) rotation to respond to incidents that impact availability - Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users - Build monitoring systems to ensure the highest quality service for our customers - Design and implement operational processes (such as deployments and upgrades) - Debug production issues across all services and levels of the stack - Identify improvements for the product architecture from the reliability, performance and availability perspectives - Plan the growth of Together AI’s infrastructure Qualifications - 7+ years of professional SRE or related experience - Must have experience operating GPU-enabled Kubernetes clusters or AI infrastructure supporting machine learning training and inference workloads - Bachelor's degree in Computer Science or a related field or equivalent work experience - Expert knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes - Proficiency in programming/scripting languages - Direct experience in monitoring and observability practices - Advanced knowledge of cloud services - Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts Company Description Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.

• Design, implement, and optimize cloud-native infrastructure using best practices for security, scalability, and high availability • Integrate newly acquired cloud environments into the organization’s cloud footprint • Develop and implement hybrid-cloud and cross-cloud connectivity strategies • Architect, optimize, and maintain secure network infrastructure in Azure, AWS, & GCP • Collaborate with security teams to enforce Zero Trust networking • Maintain and expand a modular network security edge • Automate cloud infrastructure provisioning using Terraform and Ansible • Implement policy-based automation • Support observability teams with infrastructure monitoring and alerting • Drive transformation and standardization of foundational infrastructure services

• Plan, design, and build secure infrastructure for AI-assisted development and testing • Data-access security across the platform • Cross-cutting application features • Manage your own projects, communicating designs, plans, and status updates proactively.

Role Description This is a fully remote, full-time position. We’re looking for a mid to senior-level Cloud Infrastructure Engineer to strengthen our end-to-end delivery and operational capabilities across: - CI/CD automation - Build and release engineering - Container security - AWS cloud enablement - Reliability tooling This role is highly hands-on and innovation-driven: - Prototype new DevOps and cloud automation approaches - Validate prototypes quickly - Turn successful prototypes into reusable standards (shared pipeline modules, secure base artifacts, and repeatable infrastructure/patterns) Integrate quality and security controls using tools like: - JFrog Artifactory/Xray - SonarQube - GitHub - Grafana - Optionally Datadog/New Relic Build Python-based automation that reduces toil and improves consistency across environments—including AWS services such as: - RDS - Glue - QuickSight Qualifications - Bachelor’s degree in computer science, Software Engineering, or related field, or equivalent practical experience - 4–8+ years’ experience in DevOps / Platform Engineering / CI/CD / Cloud Engineering (mid to senior level) - Strong hands-on expertise in Jenkins, including Jenkins Shared Libraries and reusable pipeline modules - Strong knowledge of Docker and container fundamentals (container OS concepts, layering, caching, base image strategies) - Hands-on experience with JFrog Artifactory and JFrog Xray (policies, scanning, governance, promotion workflows) - Infrastructure as Code experience (Terraform / CloudFormation / Ansible) - Strong understanding of semantic versioning and release management discipline - Solid experience with AWS and familiarity with RDS, Glue, and QuickSight - Proficiency in Python for automation, tooling, and integrations - Experience with DevOps tools such as GitHub, SonarQube, and Grafana - Strong communication skills; comfortable collaborating in a fully remote environment Requirements - A willingness to continually learn and adapt to the evolving technology landscape - Ability to work in a fast-paced environment and manage multiple projects simultaneously - All work must be conducted within the U.S., excluding U.S. territories - Some federal contracts require U.S. citizenship to be eligible for employment - You must be legally authorized to work in the U.S. now and in the future without sponsorship - As the US Government is our clientele, you may be required to obtain a public trust or security clearance - Some of our available roles are on federal contracts that require a degree or additional years of experience as a substitute Benefits - Competitive salary and benefits package, including health, dental, and vision insurance - Retirement plan and generous paid time off - Opportunity to work with a talented team of professionals on exciting and innovative projects - Flexible work arrangements, including remote work options - Continuous learning and development opportunities, including access to training resources and professional development programs - A collaborative, inclusive work environment that values diversity and encourages growth