AI / DevOps Engineer (Test Automation & Telemetry) We are seeking a Senior AI / DevOps Engineer to work on advanced automated testing and telemetry systems supporting large-scale AI-driven workflows. You will operate inside a high-visibility engineering environment where automated agents interact with complex applications and generate telemetry events used to evaluate system behavior and reliability. This role requires engineers who are comfortable operating independently, collaborating with senior stakeholders, and working in evolving AI-driven infrastructure environments. What You’ll Be Working On The team builds and maintains automated testing infrastructure that: - Drives automated application interactions - Generates telemetry events and behavioral signals - Monitors workflow success and system health - Uses AI tooling to generate and analyze events - Supports large-scale experimentation and evaluation You will work closely with senior engineers and technical leads to expand event generation capabilities and build AI-assisted tooling for telemetry and automated evaluation pipelines. Core Responsibilities - Build and maintain automated telemetry and event-generation systems - Develop and improve AI-assisted tooling for event creation and monitoring - Debug automated test runs and investigate anomalies in telemetry data - Build alerts and monitoring for automated test systems - Analyze workflow sequences and event chains to validate system behavior - Work with internal engineering teams to improve test coverage and reliability - Investigate dips or anomalies in telemetry dashboards and propose fixes - Contribute to the evolution of agent-driven testing infrastructure - Maintain consistent engineering visibility through written updates, documentation, and collaboration with partner teams. - You will work on AI-assisted testing infrastructure and telemetry pipelines that generate and analyze large volumes of application events. What Success Looks Like Within the first month(s), you will: - Understand telemetry pipelines and automated testing workflows - Analyze event sequences and system behavior using internal dashboards - Build AI-assisted tooling to improve event generation efficiency - Help scale event coverage toward large test suites - Improve signal quality by reducing noisy or non-actionable alerts Required Experience - Strong software engineering experience (5+ years) - Python or similar scripting language - Linux development environments - Debugging distributed or automated systems - Experience working with telemetry, logging, or monitoring systems - Familiarity with CI/CD or build systems - Strong written communication and documentation skills Strong Plus - Experience with AI tooling or LLM-based workflows - Experience building automation frameworks - Experience with test infrastructure or QA automation - Experience with mobile application testing (Android / iOS) - Experience analyzing telemetry or event pipelines - Experience working in large enterprise engineering environments What We’re Looking For This role requires engineers who: - Take ownership of systems, not just tasks - Communicate clearly and proactively - Work well in ambiguous environments - Are comfortable collaborating with senior stakeholders - Can debug complex systems without extensive hand-holding - Move quickly while maintaining engineering discipline Why This Role Is Unique You’ll be working at the intersection of: - AI-driven automation - large-scale telemetry systems - agent-based evaluation infrastructure This is a rare opportunity to work on the next generation of automated software evaluation systems used in complex AI environments. About Us Flowmentum builds high-impact engineering teams embedded within some of the world’s most advanced technology organizations. Our engineers work on DevOps infrastructure, automation systems, AI-driven workflows, and platform reliability. Location Remote (US-friendly time zones preferred) Engagement Contract / Consulting (long-term)

• Support the design and engineering of a DevOps Platform to enable a shared system of systems to support software development, systems engineering, integration, and test of software applications and infrastructure in a heterogeneous environment. • Develops GitLab CI/CD Pipelines. • Design, build, and maintain modular, reusable IaC configurations using Terraform across cloud platforms like AWS, or similar. • Automates configurations within Kubernetes. • Supports cloud networking and routing for DNS, TLS, and Ingress/Egress. • Maintains and Hardens Base Images Within Cloud Environments, support the development and documentation of risk assessment results and recommendations using identified threats, applicable vulnerabilities, and likelihood of occurrence within context of risk tolerances, providing recommendations for corrective actions and mitigation strategies. • Provide automated and manual validations of Information Assurance Controls (IACs) and Validation Procedures (VPs) in accordance with the DoD Guidelines, CNSSI 1253 and/or NIST 800 Publications. • Perform validation, troubleshooting, and documentation for DevSecOps engineering efforts. • Document processes and services for use by cloud application development teams. • Participates in Agile process to develop tasking, describe technical solutions, and test deployed systems.

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description Our client is seeking a DevOps Engineer to build, maintain, and optimize infrastructure and deployment pipelines. This role requires expertise in cloud platforms, automation, monitoring, and CI/CD. The DevOps Engineer ensures systems are secure, scalable, and reliable, enabling development teams to ship code quickly and safely. Responsibilities - Infrastructure Management: - Provision and manage infrastructure on AWS, GCP, or Azure. - Implement Infrastructure-as-Code using Terraform, Pulumi, or CloudFormation. - Configure networking, storage, and compute resources to scale with demand. - CI/CD Pipelines: - Build and maintain pipelines with GitHub Actions, Jenkins, GitLab CI, or CircleCI. - Automate builds, tests, and deployments across multiple environments. - Ensure rollback strategies and zero-downtime deployments. - Containerization & Orchestration: - Manage Docker containers and Kubernetes clusters. - Deploy microservices and monitor cluster health. - Optimize cost and performance for containerized workloads. - Monitoring & Incident Response: - Implement observability with Prometheus, Grafana, Datadog, or New Relic. - Configure logging and alerting pipelines (ELK stack, Splunk). - Participate in on-call rotations, performing root cause analysis post-incident. - Security & Compliance: - Apply cloud security best practices (IAM, least privilege, encryption). - Support SOC 2, HIPAA, PCI, or GDPR compliance in infrastructure. - Run vulnerability scans and patch systems proactively. - Collaboration & Process Improvement: - Partner with developers to streamline deployments and remove bottlenecks. - Document infrastructure, pipelines, and workflows for team knowledge. - Identify opportunities for automation and performance optimization. Qualifications - 3+ years experience in DevOps, SRE, or infrastructure engineering. - Proficiency with at least one cloud provider (AWS, GCP, Azure). - Strong knowledge of CI/CD tools and pipelines. - Experience with Docker and Kubernetes. Ideal Experience & Skills - Terraform or Pulumi Infrastructure-as-Code expertise. - Industry background in SaaS, fintech, healthcare, or enterprise applications. - Familiarity with serverless deployments (AWS Lambda, Google Cloud Functions). - Security certifications or cloud certifications (AWS Certified DevOps Engineer, CKA, etc.). What Makes You a Perfect Fit - Problem solver who thrives at the intersection of development and operations. - Calm and methodical in high-pressure incident scenarios. - Passionate about automation, scalability, and reliability. - Strong communicator who bridges technical and business needs. What Does a Typical Day Look Like? A DevOps Engineer’s day revolves around keeping systems secure, automated, and reliable. You will: - Review monitoring dashboards for performance and incident alerts. - Update CI/CD pipelines to improve build/test/deploy efficiency. - Provision or modify infrastructure with Terraform or CloudFormation. - Collaborate with developers to troubleshoot deployments or optimize services. - Document workflows and update runbooks for incident response. - End the day by analyzing logs, reviewing metrics, and planning optimizations. In essence: you are the custodian of infrastructure and automation, ensuring systems scale, stay secure, and support fast product delivery. Key Metrics for Success (KPIs) - Deployment frequency (faster, more reliable releases). - System uptime ≥ 99.9%. - MTTR (Mean Time to Recovery) reduced for incidents. - Cost efficiency of infrastructure usage. - Positive developer feedback on deployment speed and reliability. Interview Process - Initial Phone Screen - Video Interview with Pavago Recruiter - Technical Task (e.g., design a CI/CD pipeline or provision infrastructure with Terraform) - Client Interview with Engineering/DevOps Leadership - Offer & Background Verification

• Develop automation and utilize monitoring tools to ensure system reliability • Participate in incident response and troubleshooting • Identify and address performance bottlenecks • Collaborate with development teams to ensure software design meets operational requirements • Continuously improve processes and procedures to increase system reliability and efficiency • Design, code, and debug applications while assisting with CI/CD pipelines, automating infrastructure tasks, and ensuring system scalability and security