Careerflow.ai logo
Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Data Annotation Specialist - Computer Use Agents (CUA) Trajectory Evaluator

AI EngineerMachine Learning EngineerFull TimeRemoteMid LevelTeam 11-50

Location

Ghana

Posted

75 days ago

Salary

$10 / hour

Seniority

Mid Level

Job Description

Data Annotation Specialist - Computer Use Agents (CUA) Trajectory Evaluator

Careerflow.ai

Role Description We are looking for skilled professionals to contribute as S2 Annotators, responsible for producing and validating high-quality Computer-Use Agent (CUA) trajectories for developer-adjacent workflows. This includes tasks such as file operations, light scripting, API interactions, and browser automation. This role requires a strong understanding of technical workflows, attention to detail, and the ability to translate natural language instructions into precise, step-by-step executable actions that can be used to train advanced AI systems. What does day-to-day look like: - Create detailed, step-by-step positive CUA trajectories for technical tasks (e.g., file manipulation, scripting, API calls, browser-based workflows) - Break down natural language instructions into clear, verifiable actions - Validate and review trajectories for correctness, completeness, and reproducibility - Work within Linux desktop environments to execute and document workflows - Use scripting (Python/Bash) to simulate or validate task execution where required - Interact with tools and environments involving APIs, terminals, and browser automation - Collaborate with internal teams to refine task quality and annotation guidelines - Ensure consistency, accuracy, and high-quality standards across all annotations Qualifications - 2–5 years of experience in software development, technical support, or similar technical roles - Strong familiarity with Linux environments and command-line operations - Proficiency in at least one scripting language: Python or Bash - Ability to decompose complex instructions into structured, step-by-step workflows - Strong attention to detail in documenting technical processes - Exposure to LLM-based tools, AI systems, or agentic workflows - Basic understanding of APIs, file systems, and developer tooling - Familiarity with OpenClaw or similar environments/tools Requirements - Prior experience in data annotation, RLHF, or SFT labeling workflows (nice to have) - Exposure to CI/CD pipelines, REST APIs, or terminal-based automation (nice to have) - Experience working with browser automation tools or developer productivity tools (nice to have) - Background in evaluating or improving AI-generated outputs (nice to have) Benefits - Engagement type: Contractor assignment/freelancer (no medical/paid leave) - Duration: 5 weeks Evaluation Process - Resume screening - Take home assessment (60 mins)

Job Requirements

  • 2–5 years of experience in software development, technical support, or similar technical roles
  • Strong familiarity with Linux environments and command-line operations
  • Proficiency in at least one scripting language: Python or Bash
  • Ability to decompose complex instructions into structured, step-by-step workflows
  • Strong attention to detail in documenting technical processes
  • Exposure to LLM-based tools, AI systems, or agentic workflows
  • Basic understanding of APIs, file systems, and developer tooling
  • Familiarity with OpenClaw or similar environments/tools
  • Prior experience in data annotation, RLHF, or SFT labeling workflows (nice to have)
  • Exposure to CI/CD pipelines, REST APIs, or terminal-based automation (nice to have)
  • Experience working with browser automation tools or developer productivity tools (nice to have)
  • Background in evaluating or improving AI-generated outputs (nice to have)

Benefits

  • Engagement type: Contractor assignment/freelancer (no medical/paid leave)
  • Duration: 5 weeks
  • Evaluation Process
  • Resume screening
  • Take home assessment (60 mins)

Related Job Pages

More AI Engineer Jobs

GSB Solutions logo

AI Engineer

GSB Solutions

Innovating Services with Human Value

AI Engineer75 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

• Design and develop ML models for high impact engineering solutions • Build, train, and optimize machine learning and deep learning models to solve complex problems • Data collection and preprocessing • Feature engineering • Model evaluation and monitoring • Deployment and integration • Research and innovation • Documentation and reporting • Uphold ethical standards and ensure compliance with regulations

Mexico
$110K / year
Job Closed
FourKites, Inc. logo

Senior AI Engineer

FourKites, Inc.

Real-Time Transportation Visibility Platform

AI Engineer75 days ago
Full TimeRemoteTeam 501-1,000Since 2014H1B No Sponsor

• Develop, test and maintain Java backend applications • Write clean, efficient, and well-documented code • Design and implement data models and database schemas • Collaborate with the frontend team to integrate the backend with the user interface • Perform code reviews and ensure code quality standards are met • Troubleshoot and debug applications • Work with the DevOps team to deploy and manage applications in production • Continuously learn and stay up-to-date with new technologies and industry trends

India
Job Closed
RLVNT.AI logo

AI Engineer – KI-Spezialist

RLVNT.AI

Wir verbinden die Erfahrung und Kreativität unseres Teams mit der Power von KI | Top 3 Kommunikationsberatung 2024

AI Engineer75 days ago
Full TimeRemoteTeam 11-50Since 2014H1B No Sponsor

• Als AI Engineer (m/w/d) hast du die Chance, an wegweisenden Projekten zu arbeiten und intelligente Systeme zu entwickeln, die die Art und Weise, wie wir arbeiten und leben, revolutionieren. • Nutze deine Expertise im Machine Learning, um den Fortschritt in unserer Branche aktiv voranzutreiben und werde Teil von RLVNT!

Germany
Job Closed
sandan AI logo

Content Creator, AI Platform – English Market

sandan AI

Dream at human scale. Grow with AI. Building the leading growth platform for entrepreneurs of tomorrow. | eCom & SaaS

AI Engineer75 days ago
Full TimeRemoteTeam 11-50Since 2025H1B No Sponsor

• Create engaging social media content (LinkedIn, YouTube, Instagram, TikTok, Twitter) • Produce videos: tutorials, demos, behind-the-scenes • Showcase AI tools, design workflows, and marketing automation • Build an engaged audience in the AI/tech/marketing space • Collaborate with our team on content strategy • Stay on top of trends and incorporate them into content

United Arab Emirates