At Cohere, our mission is to build machines that understand the world, and to make them safely accessible to all.
Data Annotation Specialist, Software Engineering
Location
Canada
Posted
4 days ago
Salary
$40 / hour
Seniority
Senior
Job Description
Data Annotation Specialist, Software Engineering
Cohere
• Evaluate the model's ability to respond to coding requests, workflows, and code base-related questions using available tools. • Assess agent trajectories and model capabilities for code generation and debugging requests. • Prompt models to complete complex coding tasks and review the accuracy of generated responses. • Label, proofread, and improve machine-written and human-written software engineering-related outputs. • Report quality and performance trends related to model/agent behaviour and project assignments.
Job Requirements
- Subject matter expertise in software engineering - you have both studied in this field and have 3-5 years of relevant industry experience.
- Proficient knowledge and understanding of Python and the following programming languages: Java, JavaScript, Go, and SQL (any dialect).
- Prior experience designing, building, and deploying APIs
- Prior experience working with code agents (OpenCode, Claude Code, Codex, Cursor) or evaluating agent trajectories is a big plus.
Benefits
- Performance incentives included!
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Principal Engineer, Data Center Deployment Ops
DigitalOceanThe cloud ☁️ of choice for developers, startups, and growing digital businesses around the world.
• Defining and owning DigitalOcean's reference architectures for next-generation Data Center environments • Serving as a primary technical stakeholder for MEP systems • Provide leadership and guidance in new site selection process • Architecting end-to-end cooling designs • Architecting end-to-end power topologies • Leading proof-of-concept initiatives for infrastructure technologies • Guiding leadership on implications of non-traditional data center facilities • Mentoring engineers and contributing to technical excellence
• Collaborate with clients and business stakeholders to deeply understand and clarify business needs and translate them into technical solutions • Navigate the entire product lifecycle as a full-stack engineer: from requirements gathering, scoping, and planning, through to implementation and deployment, leveraging advanced AI tools to accelerate and optimize every stage • Break down and explain technical concepts clearly during client interactions and team discussions • Move fluidly across the application layers, utilizing AI tools to rapidly upskill and deliver on varied engineering challenges. While our primary stack is TypeScript/Vue.js on the frontend and Java or Python on the backend, we value strong foundational engineering skills that allow you to adapt as project directions evolve. • Write clean, maintainable, and scalable code guided by strong development principles • Conduct code reviews and actively participate in team knowledge sharing
Senior Full Stack Developer, SharePoint
BlackStone eITA global team who's passionate about transformative enterprise solutions & intelligent design
• Develop, enhance, and maintain SharePoint Online / SharePoint On-Premise solutions. • Build and customize SharePoint pages, lists, libraries, workflows, forms, and web parts. • Support SharePoint integration with other systems using APIs, connectors, Power Automate, or custom development. • Handle full stack development tasks including backend logic, frontend interfaces, database work, and system integrations. • Support troubleshooting, bug fixing, performance improvement, and production support activities. • Assist in SharePoint migration activities, including content migration, permission mapping, testing, and post-migration support. • Work on multiple assignments across different projects and accounts based on business priority. • Prepare technical documentation, deployment notes, and handover details when required. • Coordinate with internal teams and client-side stakeholders to clarify requirements and deliver solutions.
Full Stack Developer – 5 Months Contract
FE fundinfoGlobal leader in investment fund data and technology
• Designing and implementing backend features using C# .NET Framework across multiple platform modules. • Developing and maintaining SOAP-based web services and integrating them with frontend and API consumers. • Building and enhancing UI components using TypeScript frameworks such as Sencha ExtJS. • Creating and optimizing SQL Server database objects, including stored procedures, views, and schema designs. • Developing ETL pipelines using SSIS and managing data integrations from regulatory and third-party sources. • Collaborating with cross-functional teams to deliver features end-to-end, from design to deployment within a DevOps-driven environment.




