The future of AI is open-source. Let's build together.
AI Infrastructure Engineer
Location
India
Posted
5 days ago
Salary
0
Seniority
Mid Level
Job Description
AI Infrastructure Engineer
Together AI
Role Description As a AI Infrastructure Engineer (SRE) at Together, you are responsible for keeping all user-facing services and production systems running smoothly. You are a blend of a pragmatic operator and a software engineer that applies sound engineering principles, operational discipline, and mature automation to our operating environments and codebase. You specialize in systems (operating systems, storage subsystems, networking), while implementing best practices for availability, reliability and scalability, with varied interests in algorithms and distributed systems. Ideally based close to Bangalore or remote India. - Be on an on-call (PagerDuty) rotation to respond to incidents that impact availability - Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users - Build monitoring systems to ensure the highest quality service for our customers - Design and implement operational processes (such as deployments and upgrades) - Debug production issues across all services and levels of the stack - Identify improvements for the product architecture from the reliability, performance and availability perspectives - Plan the growth of Together AI’s infrastructure Qualifications - 7+ years of professional SRE or related experience - Must have experience operating GPU-enabled Kubernetes clusters or AI infrastructure supporting machine learning training and inference workloads - Bachelor's degree in Computer Science or a related field or equivalent work experience - Expert knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes - Proficiency in programming/scripting languages - Direct experience in monitoring and observability practices - Advanced knowledge of cloud services - Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts Company Description Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers and engineers in our journey in building the next generation AI infrastructure.
Related Guides
Related Categories
Related Job Pages
More Infrastructure Engineer Jobs
Staff Cloud Infrastructure Engineer
DatavantDatavant is a software development company working to eliminate the silos of healthcare information that hold back improved patient care and innovative medical
• Design, implement, and optimize cloud-native infrastructure using best practices for security, scalability, and high availability • Integrate newly acquired cloud environments into the organization’s cloud footprint • Develop and implement hybrid-cloud and cross-cloud connectivity strategies • Architect, optimize, and maintain secure network infrastructure in Azure, AWS, & GCP • Collaborate with security teams to enforce Zero Trust networking • Maintain and expand a modular network security edge • Automate cloud infrastructure provisioning using Terraform and Ansible • Implement policy-based automation • Support observability teams with infrastructure monitoring and alerting • Drive transformation and standardization of foundational infrastructure services
• Plan, design, and build secure infrastructure for AI-assisted development and testing • Data-access security across the platform • Cross-cutting application features • Manage your own projects, communicating designs, plans, and status updates proactively.
Cloud Infrastructure Engineer
Archesys IncArchesys is a technology firm specializing in innovative cloud solutions and services for clients across various industries. We pride ourselves on cutting-edge technologies, exceptional customer service, and a collaborative work environment.
Role Description This is a fully remote, full-time position. We’re looking for a mid to senior-level Cloud Infrastructure Engineer to strengthen our end-to-end delivery and operational capabilities across: - CI/CD automation - Build and release engineering - Container security - AWS cloud enablement - Reliability tooling This role is highly hands-on and innovation-driven: - Prototype new DevOps and cloud automation approaches - Validate prototypes quickly - Turn successful prototypes into reusable standards (shared pipeline modules, secure base artifacts, and repeatable infrastructure/patterns) Integrate quality and security controls using tools like: - JFrog Artifactory/Xray - SonarQube - GitHub - Grafana - Optionally Datadog/New Relic Build Python-based automation that reduces toil and improves consistency across environments—including AWS services such as: - RDS - Glue - QuickSight Qualifications - Bachelor’s degree in computer science, Software Engineering, or related field, or equivalent practical experience - 4–8+ years’ experience in DevOps / Platform Engineering / CI/CD / Cloud Engineering (mid to senior level) - Strong hands-on expertise in Jenkins, including Jenkins Shared Libraries and reusable pipeline modules - Strong knowledge of Docker and container fundamentals (container OS concepts, layering, caching, base image strategies) - Hands-on experience with JFrog Artifactory and JFrog Xray (policies, scanning, governance, promotion workflows) - Infrastructure as Code experience (Terraform / CloudFormation / Ansible) - Strong understanding of semantic versioning and release management discipline - Solid experience with AWS and familiarity with RDS, Glue, and QuickSight - Proficiency in Python for automation, tooling, and integrations - Experience with DevOps tools such as GitHub, SonarQube, and Grafana - Strong communication skills; comfortable collaborating in a fully remote environment Requirements - A willingness to continually learn and adapt to the evolving technology landscape - Ability to work in a fast-paced environment and manage multiple projects simultaneously - All work must be conducted within the U.S., excluding U.S. territories - Some federal contracts require U.S. citizenship to be eligible for employment - You must be legally authorized to work in the U.S. now and in the future without sponsorship - As the US Government is our clientele, you may be required to obtain a public trust or security clearance - Some of our available roles are on federal contracts that require a degree or additional years of experience as a substitute Benefits - Competitive salary and benefits package, including health, dental, and vision insurance - Retirement plan and generous paid time off - Opportunity to work with a talented team of professionals on exciting and innovative projects - Flexible work arrangements, including remote work options - Continuous learning and development opportunities, including access to training resources and professional development programs - A collaborative, inclusive work environment that values diversity and encourages growth
Infrastructure Engineer III
Project Management InstituteProject Management Institute, Inc. is committed to providing equal employment opportunities without regard to sex, gender identity, sexual orientation, race, color, religious creed, national origin, physical or mental disability, protected veteran status, or any other characteristic protected by applicable law.
Role Description Are you a dreamer, innovator, thinker and a do-er who believes in contributing to something that makes a difference? Pursue your passion. Join PMI. You will serve as a senior technical contributor responsible for designing, engineering, and supporting secure, scalable cloud infrastructure with a primary focus on Microsoft Azure. Leading infrastructure and security-driven design decisions across network architecture, identity, and data protection, while partnering closely with engineering and security teams to embed controls into all cloud solutions and advance modernization initiatives. Leveraging Infrastructure-as-Code, cloud best practices, and expertise in identity and access management, you will ensure environments are reliable, resilient, and cost-efficient, while aligning with enterprise standards, governance requirements, and evolving business and technology needs. Qualifications - Deep expertise in Microsoft Azure cloud platforms and services. - Working knowledge of other major cloud environments including AWS and GCP. - Proven experience architecting and engineering secure cloud solutions, including network security, segmentation, and zero-trust principles. - Hands-on experience with Infrastructure-as-Code, preferably ARM templates or Bicep (Terraform also valuable). - Experience with CI/CD Deployment Tools, preferably Azure DevOps (ADO). - Strong understanding and practical experience with IAM, RBAC, and identity governance in cloud platforms. - Solid knowledge of cloud security frameworks, best practices, and compliance considerations. - Strong troubleshooting and analytical skills with the ability to perform root cause analysis and resolve complex infrastructure issues. - Experience with emerging AI tooling and technologies, particularly in evaluating, securing, and governing AI-enabled platforms, MCP/integrations, and data access patterns. - Strong documentation and diagramming skills, with the ability to clearly communicate architecture, design, and operational procedures. - Ability to rapidly learn new technologies, evaluate options, and move work forward even when requirements, priorities, and technical direction may still be evolving. - Light development experience is a plus, particularly with .NET and React, to support application teams and better understand end-to-end solution design. Benefits - An excellent total package, with compensation and benefits based upon your geographic location. - Skill development opportunities, to help you grow now and into the future. - Access to a global network, to enrich your professional experience. - Flexible options to help balance work time and your time. - Award and bonus opportunities.


