Job Closed
This listing is no longer active.
Make anything multilingual. Translation, AI data set creation, and human expert evals. For businesses and governments.
Software Engineer, DevOps AI Rater/Evaluator
Location
Worldwide
Posted
95 days ago
Salary
0
Seniority
Senior
Job Description
Software Engineer, DevOps AI Rater/Evaluator
LILT AI
• Evaluate AI outputs related to software engineering, DevOps, and infrastructure topics • Perform structured scoring, comparison, classification, and judgment tasks • Assess technical correctness, completeness, security implications, and best-practice alignment • Identify hallucinations, incorrect code, unsafe recommendations, or misleading system guidance • Apply domain-specific engineering and DevOps guidelines consistently across tasks
Job Requirements
- Software engineers, site reliability engineers, DevOps engineers, or platform engineers
- Experience with production systems, CI/CD pipelines, cloud infrastructure, or distributed systems
- Strong attention to detail and comfort working with structured evaluation criteria
- Native or professional fluency in one or more supported languages is required
- English fluency is required for guidelines, feedback, and collaboration
Benefits
- Contract-based, flexible participation
- Project-based work with clear expectations and timelines
- Opportunities for recurring work based on performance and demand
- Compensation communicated upfront per project or task type
Related Guides
Related Categories
Related Job Pages
More DevOps Engineer Jobs
Release Train Engineer (Remote – Quarterly Travel Required) What’s in It for Me? Step into a highly visible leadership role where you’ll guide Agile teams, influence delivery outcomes, and drive continuous improvement across a complex technology ecosystem. If you thrive on big‑picture coordination, cross‑team collaboration, and enabling others to do their best work, this role puts you at the center of meaningful transformation. Where? This is a primarily remote position. Quarterly travel (3–4 days) to the organization’s HQ in Tampa, FL is required, along with occasional additional travel for special planning sessions. Job Details Salary Range: $120,000 – $125,000 + bonus Employment Type: Full-time Work Hours: Standard business hours Location: Remote (Quarterly travel to Tampa required) Job Duties - Facilitate all Agile Release Train (ART) ceremonies, including PI Planning/BRP, System Demos, Inspect & Adapt, and Scrum of Scrums. - Coach Scrum Masters, teams, and leaders on Lean‑Agile mindset, practices, and behaviors to enhance delivery effectiveness. - Track program objectives, risks, and cross‑team dependencies to optimize execution and ensure predictable delivery. - Foster a culture of continuous improvement through data-driven insights, retrospectives, and transparent communication with stakeholders. - Coordinate planning logistics for in‑person quarterly events in partnership with internal teams and vendor partners. Job Requirements Minimum Qualifications - Strong knowledge of SAFe® (Scaled Agile Framework) and Lean‑Agile principles - Experience coaching and facilitating Agile teams - Prior people‑leadership experience (mentoring, development, oversight of Scrum Masters) - Excellent communication and leadership skills with the ability to influence without authority - Background in Agile delivery leadership or program/project management - Ability to manage complex dependencies and resolve conflicts constructively - Proficiency with Agile tools such as Jira, Rally, or Azure DevOps Preferred Qualifications - SAFe® RTE certification or similar credential - Experience supporting large-scale Agile transformations - Technical understanding of system architecture and integration - Comfort facilitating events and workshops with 100+ attendees
• Design, build, and maintain cloud infrastructure for our distributed build acceleration platform • Automate everything: from deployment pipelines to monitoring and recovery • Manage scalability and reliability for high-throughput, low-latency systems • Implement and maintain observability: logging, metrics, tracing, and alerting • Work closely with product and engineering teams to embed reliability into every feature • Diagnose and resolve production incidents quickly, and feed learnings back into systems design • Optimize cost, performance, and resilience across multi-cloud environments
Senior DevOps Engineer
Meazure LearningOffering full-service assessment development, delivery, and proctoring solutions across the world
• Help define and elevate the user experience for learners and professionals around the world • Collaborate with talented, mission-driven colleagues across regions • Work in a culture that values trust, innovation, and transparency • Design, implement, and maintain scalable, secure, and reliable CI/CD pipelines • Manage and optimize cloud infrastructure (e.g., AWS, Azure) and container orchestration (e.g., Kubernetes) • Drive automation across infrastructure and development workflows • Build and maintain monitoring, alerting, and logging systems to ensure reliability and observability • Collaborate with Engineering, QA, and Security teams to deliver high-performing, compliant solutions • Troubleshoot complex system issues in staging and production environments • Guide and mentor junior engineers and contribute to DevOps best practices
DevOps Engineer – Mid
Nord SecurityNord Security is the leader in providing digital security and privacy solutions for individuals and businesses.
• Implement and maintain Infrastructure as Code (IaC) using Terraform. • Develop, manage, and optimize Terraform modules. • Manage and optimize AWS Cloud infrastructure, ensuring performance, scalability, and availability requirements are met. • Assist in implementing and maintaining monitoring and logging systems (e.g., ELK, Grafana, Thruk). • Provide technical support for infrastructure, CI/CD pipelines, and deployment processes. • Troubleshoot and resolve infrastructure-related issues, ensuring smooth operations. • Document and maintain DevOps workflows, processes, and system configurations.



