Cohere logo
Cohere

At Cohere, our mission is to build machines that understand the world, and to make them safely accessible to all.

Data Annotation Specialist, Software Engineering

Location

Canada

Posted

4 days ago

Salary

$40 / hour

Seniority

Senior

Bachelor Degree3 yrs expEnglishJavaJavaScriptPythonSQLGo

Job Description

Data Annotation Specialist, Software Engineering

Cohere

• Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools. • Assess agent trajectories and model capabilities for code generation and debugging requests. • Prompt models to complete complex coding tasks and review the accuracy of generated responses. • Label, proofread, and improve machine-written and human-written software engineering-related outputs. • Report quality and performance trends related to model/agent behaviour and project assignments.

Job Requirements

  • Subject matter expertise in software engineering - you have both studied in this field and have 3-5 years of relevant industry experience.
  • Proficient knowledge and understanding of Python and the following programming languages: Java, JavaScript, Go, and SQL (any dialect).
  • Prior experience designing, building, and deploying APIs
  • Prior experience working with code agents (OpenCode, Claude Code, Codex, Cursor) or evaluating agent trajectories is a big plus.

Benefits

  • Performance incentives included!

Related Job Pages

More Full-stack Engineer Jobs

DigitalOcean logo

Principal Engineer, Data Center Deployment Ops

DigitalOcean

The cloud ☁️ of choice for developers, startups, and growing digital businesses around the world.

Full TimeRemoteTeam 1,001-5,000Since 2011H1B Sponsor

• Defining and owning DigitalOcean's reference architectures for next-generation Data Center environments • Serving as a primary technical stakeholder for MEP systems • Provide leadership and guidance in new site selection process • Architecting end-to-end cooling designs • Architecting end-to-end power topologies • Leading proof-of-concept initiatives for infrastructure technologies • Guiding leadership on implications of non-traditional data center facilities • Mentoring engineers and contributing to technical excellence

California
$184K - $231K / year
Space Inch logo

Full-Stack Engineer

Space Inch

Client-Tailored. Engineer-Driven.

Full TimeRemoteTeam 11-50Since 2013H1B No Sponsor

• Collaborate with clients and business stakeholders to deeply understand and clarify business needs and translate them into technical solutions • Navigate the entire product lifecycle as a full-stack engineer: from requirements gathering, scoping, and planning, through to implementation and deployment, leveraging advanced AI tools to accelerate and optimize every stage • Break down and explain technical concepts clearly during client interactions and team discussions • Move fluidly across the application layers, utilizing AI tools to rapidly upskill and deliver on varied engineering challenges. While our primary stack is TypeScript/Vue.js on the frontend and Java or Python on the backend, we value strong foundational engineering skills that allow you to adapt as project directions evolve. • Write clean, maintainable, and scalable code guided by strong development principles • Conduct code reviews and actively participate in team knowledge sharing

Croatia
€4K - €5.2K / month
BlackStone eIT logo

Senior Full Stack Developer, SharePoint

BlackStone eIT

A global team who's passionate about transformative enterprise solutions & intelligent design

Full TimeRemoteTeam 201-500H1B No Sponsor

• Develop, enhance, and maintain SharePoint Online / SharePoint On-Premise solutions. • Build and customize SharePoint pages, lists, libraries, workflows, forms, and web parts. • Support SharePoint integration with other systems using APIs, connectors, Power Automate, or custom development. • Handle full stack development tasks including backend logic, frontend interfaces, database work, and system integrations. • Support troubleshooting, bug fixing, performance improvement, and production support activities. • Assist in SharePoint migration activities, including content migration, permission mapping, testing, and post-migration support. • Work on multiple assignments across different projects and accounts based on business priority. • Prepare technical documentation, deployment notes, and handover details when required. • Coordinate with internal teams and client-side stakeholders to clarify requirements and deliver solutions.

India
FE fundinfo logo

Full Stack Developer – 5 Months Contract

FE fundinfo

Global leader in investment fund data and technology

ContractRemoteTeam 1,001-5,000H1B No Sponsor

• Designing and implementing backend features using C# .NET Framework across multiple platform modules. • Developing and maintaining SOAP-based web services and integrating them with frontend and API consumers. • Building and enhancing UI components using TypeScript frameworks such as Sencha ExtJS. • Creating and optimizing SQL Server database objects, including stored procedures, views, and schema designs. • Developing ETL pipelines using SSIS and managing data integrations from regulatory and third-party sources. • Collaborating with cross-functional teams to deliver features end-to-end, from design to deployment within a DevOps-driven environment.

India