We are seeking a Principal AI Operations Engineer to define the technical direction for the AI Operations group. In this role, you will: Design and architect operational systems Establish standards for branch health, CI/CD pipelines, production deployments, and on-call processes Drive reliability initiatives and maintain production health and uptime Ensure the platform meets its SLOs Be the escalation point for complex incidents Work closely with the Platform team to ensure services are operationally ready

The Senior Systems Administrator is responsible for ensuring the secure, reliable, and efficient operation of enterprise IT systems, networks, and infrastructure. This role proactively solves complex technical issues, implements and maintains security controls, and supports agency operations through system administration, network management, and customer-focused technical support. Own day-to-day technical decision making, escalated incident response, and enforcement of technical standards across systems and infrastructure. Collaborate closely with business partners to protect data, mitigate security risks, and support ongoing technology improvements. Work with minimal supervision, contribute to IT planning and resource management, and help drive operational efficiency through automation, documentation, and continuous improvement initiatives. Configure, monitor, and troubleshoot servers, workstations, networks, cloud platforms, and enterprise applications. Administer user access and security controls. Respond to incidents and suspicious activity. Support IT projects, upgrades, and migrations.

• Work collaboratively with software and systems engineering to deploy and manage systems within AWS Cloud. • Lead the automation and streamlining operations and processes. • Design, build, setup, and maintain tools for deployment, monitoring, and infrastructure provisioning. • Administer all systems related to R&D projects, including user creation, systems provision troubleshooting, monitoring, etc. • Create the vision and designs the automation strategy across the platform. • Troubleshoot site down issues and respond to emergency outages. • Scale infrastructure to meet demand and continuously monitor/improve the quality of infrastructure. • Participate in on-call rotation as needed.

• Provision, configure, and operate Kubernetes-based clusters for customers across multiple providers • Build automation and tooling to streamline cluster deployments and integrations • Debug customer issues across networking, storage, scheduling, and system layers • Improve reliability and scalability of both training and inference infrastructure • Design and implement monitoring, alerting, and observability for critical systems • Collaborate with engineering and product teams to plan and deliver infrastructure for new services • Participate in on-call and incident response, leading postmortems and reliability improvements