Job Closed

This listing is no longer active.

LILT AI logo
LILT AI

Make anything multilingual. Translation, AI data set creation, and human expert evals. For businesses and governments.

Software Engineer, DevOps AI Rater/Evaluator

DevOps EngineerDevOps EngineerContractRemoteSeniorTeam 201-500Since 2015H1B No SponsorCompany SiteLinkedIn

Location

Worldwide

Posted

95 days ago

Salary

0

Seniority

Senior

Bachelor DegreeEnglishDistributed Systems

Job Description

Software Engineer, DevOps AI Rater/Evaluator

LILT AI

• Evaluate AI outputs related to software engineering, DevOps, and infrastructure topics • Perform structured scoring, comparison, classification, and judgment tasks • Assess technical correctness, completeness, security implications, and best-practice alignment • Identify hallucinations, incorrect code, unsafe recommendations, or misleading system guidance • Apply domain-specific engineering and DevOps guidelines consistently across tasks

Job Requirements

  • Software engineers, site reliability engineers, DevOps engineers, or platform engineers
  • Experience with production systems, CI/CD pipelines, cloud infrastructure, or distributed systems
  • Strong attention to detail and comfort working with structured evaluation criteria
  • Native or professional fluency in one or more supported languages is required
  • English fluency is required for guidelines, feedback, and collaboration

Benefits

  • Contract-based, flexible participation
  • Project-based work with clear expectations and timelines
  • Opportunities for recurring work based on performance and demand
  • Compensation communicated upfront per project or task type

Related Categories

Related Job Pages

More DevOps Engineer Jobs

OtherRemoteTeam 11-50H1B No Sponsor

Release Train Engineer (Remote – Quarterly Travel Required) What’s in It for Me? Step into a highly visible leadership role where you’ll guide Agile teams, influence delivery outcomes, and drive continuous improvement across a complex technology ecosystem. If you thrive on big‑picture coordination, cross‑team collaboration, and enabling others to do their best work, this role puts you at the center of meaningful transformation. Where? This is a primarily remote position. Quarterly travel (3–4 days) to the organization’s HQ in Tampa, FL is required, along with occasional additional travel for special planning sessions. Job Details Salary Range: $120,000 – $125,000 + bonus Employment Type: Full-time Work Hours: Standard business hours Location: Remote (Quarterly travel to Tampa required) Job Duties - Facilitate all Agile Release Train (ART) ceremonies, including PI Planning/BRP, System Demos, Inspect & Adapt, and Scrum of Scrums. - Coach Scrum Masters, teams, and leaders on Lean‑Agile mindset, practices, and behaviors to enhance delivery effectiveness. - Track program objectives, risks, and cross‑team dependencies to optimize execution and ensure predictable delivery. - Foster a culture of continuous improvement through data-driven insights, retrospectives, and transparent communication with stakeholders. - Coordinate planning logistics for in‑person quarterly events in partnership with internal teams and vendor partners. Job Requirements Minimum Qualifications - Strong knowledge of SAFe® (Scaled Agile Framework) and Lean‑Agile principles - Experience coaching and facilitating Agile teams - Prior people‑leadership experience (mentoring, development, oversight of Scrum Masters) - Excellent communication and leadership skills with the ability to influence without authority - Background in Agile delivery leadership or program/project management - Ability to manage complex dependencies and resolve conflicts constructively - Proficiency with Agile tools such as Jira, Rally, or Azure DevOps Preferred Qualifications - SAFe® RTE certification or similar credential - Experience supporting large-scale Agile transformations - Technical understanding of system architecture and integration - Comfort facilitating events and workshops with 100+ attendees

United States
Job Closed
EngFlow logo

Site Reliability Engineer

EngFlow

faster builds that keep engineers in flow

DevOps Engineer95 days ago
OtherRemoteTeam 11-50Since 2020H1B No Sponsor

• Design, build, and maintain cloud infrastructure for our distributed build acceleration platform • Automate everything: from deployment pipelines to monitoring and recovery • Manage scalability and reliability for high-throughput, low-latency systems • Implement and maintain observability: logging, metrics, tracing, and alerting • Work closely with product and engineering teams to embed reliability into every feature • Diagnose and resolve production incidents quickly, and feed learnings back into systems design • Optimize cost, performance, and resilience across multi-cloud environments

California
Meazure Learning logo

Senior DevOps Engineer

Meazure Learning

Offering full-service assessment development, delivery, and proctoring solutions across the world

DevOps Engineer95 days ago
OtherRemoteTeam 1,001-5,000Since 2008H1B No Sponsor

• Help define and elevate the user experience for learners and professionals around the world • Collaborate with talented, mission-driven colleagues across regions • Work in a culture that values trust, innovation, and transparency • Design, implement, and maintain scalable, secure, and reliable CI/CD pipelines • Manage and optimize cloud infrastructure (e.g., AWS, Azure) and container orchestration (e.g., Kubernetes) • Drive automation across infrastructure and development workflows • Build and maintain monitoring, alerting, and logging systems to ensure reliability and observability • Collaborate with Engineering, QA, and Security teams to deliver high-performing, compliant solutions • Troubleshoot complex system issues in staging and production environments • Guide and mentor junior engineers and contribute to DevOps best practices

Virginia
Job Closed

DevOps Engineer – Mid

Nord Security

Nord Security is the leader in providing digital security and privacy solutions for individuals and businesses.

DevOps Engineer95 days ago
Full TimeRemoteTeam 1,001-5,000Since 2018H1B No Sponsor

• Implement and maintain Infrastructure as Code (IaC) using Terraform. • Develop, manage, and optimize Terraform modules. • Manage and optimize AWS Cloud infrastructure, ensuring performance, scalability, and availability requirements are met. • Assist in implementing and maintaining monitoring and logging systems (e.g., ELK, Grafana, Thruk). • Provide technical support for infrastructure, CI/CD pipelines, and deployment processes. • Troubleshoot and resolve infrastructure-related issues, ensuring smooth operations. • Document and maintain DevOps workflows, processes, and system configurations.

Poland
zł17.6K - zł23.3K / month