Role Description Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Code-Data Eval Author — Software Test Engineer / SDET Type: Contract Compensation: $30–$100/hour Location: Remote Commitment: 30+ hours/week Role Responsibilities - Design verifiers and correctness rubrics for coding tasks to ensure AI agent code functionality. - Enumerate edge cases and build adversarial test cases for comprehensive agent/model evaluation. - Grade agent trajectories and improve test/rubric quality through detailed review. - Work independently and asynchronously to meet deadlines while enhancing AI model performance. - Collaborate with subject matter experts to ensure test consistency and relevance. Qualifications - Must-Have: 5+ years as an SDET/software test engineer at a real product organization. - Proficiency in writing code and tests using automation frameworks like pytest, Playwright, Cypress. - Experience with CI/CD processes; SDET preferred over manual-only QA. - Clear written communication skills. - Preferred: Familiarity with AI tools and evaluations. Requirements - Mercor Technical Screen: Paid $200 for completing all three steps. - Live Code Review Session. - Domain Expert Interview. Benefits - Hourly contractor. - Paid weekly via Stripe Connect. Application Process - Upload resume. - AI interview based on your resume. - Submit form. Resources & Support - For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome - For any help or support, reach out to: support@mercor.com - Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Role Description The Software Engineer’s (SWE/SR) purpose is to improve overall engineering quality through documentation, technical guidance and mentoring, and applying best practices to the work. The incumbent leads significant migration efforts and routinely works with government stakeholders to get buy-in on technical initiatives. This role collaborates with the product team, government stakeholders, and other contractors to build new systems and make improvements to existing systems. These responsibilities support Nava’s culture and mission. What you'll do - Work with fellow Nava engineers to design, review, and build well-crafted software - Collaborate with government partners and other contractors to architect, implement, and deploy new systems and improvements to existing systems - Work in an agile manner to efficiently ship new features that meet user needs - Create tools and processes to automate our development, testing, and production workflows - Write and review technical documentation, performing code reviews - Participate in an on-call rotation to support production systems and investigate issues when they occur - Take part in hiring activities (e.g., submitting referrals, conducting interviews, and attending interview debriefs), as needed Qualifications - Python, JavaScript and Django or Flask - At least 7 years of experience of full-stack engineering contributing development initiatives, in a fast paced, dynamic environment in a self-directed manner, that required minimal supervision - Meaningful experience working on web-based systems, both front-end and back-end - Experience designing and implementing application architectures and code that is highly scalable, available, and performant - Self-directed, requiring minimal supervision - Experience working on large-scale applications and systems - An adaptive, empathetic, collaborative and positive mindset - Ability to think holistically around engineering issues - Knowledge of engineering fundamentals and architecture - Expertise developing well-crafted software - Excellent written and verbal communication skills, technical and otherwise - Experience with modern web development frameworks - Previous experience as a software engineer - Aptitude for giving and receiving feedback Requirements - Legal authorization to work in the United States - Ability to meet any other requirements for government contracts for which candidates are hired - Work authorization that doesn’t require visa sponsorship, now or in the future - May be subject to a government background check or security clearance, depending on the contract Benefits - Health coverage — comprehensive medical, dental, and vision plans to support your overall health needs - Insurance coverage — Nava provides disability, life, and accidental death insurance at no cost - Time off — vacation, holidays (including Juneteenth), and floating holidays to rest and recharge - Company holidays — enjoy 12 paid federal holidays each year on top of your regular PTO - Annual bonus — when Nava meets its goals, eligible employees receive a performance-based annual bonus - Parental leave — paid time off for new parents, plus weekly meals delivered to your home - Wellness program — full platform offering physical, mental, & emotional health resources & support tools - Virtual care — see doctors online with no copay through UnitedHealthcare’s virtual visit program - Sabbatical leave — earn extended unpaid leave after continuous service for personal growth or rest - 401(k) match — Nava matches 4% of your salary to support your retirement savings plan - Flexible work — remote-first environment with flexibility built around your schedule and responsibilities - Home office setup — company laptop & setup assistance provided via Staples for remote work needs - Utility support — monthly reimbursement to help offset eligible home office utility expenses - Learning opportunities — internal training programs and resources to help grow your professional skills - Development opportunities — LinkedIn Learning access & an annual allowance for courses, tuition, & certs - Referral bonus — get rewarded when you refer great people who join the Nava team - Commuter benefits — pre-tax commuter programs to support in-office travel when applicable - Supportive culture — A collaborative and remote-friendly team environment where people genuinely care

• Design, develop, and maintain test cases and test scenarios • Execute functional, integration, regression, system, and release testing • Develop and maintain automated test suites • Verify REST APIs, messaging interfaces, and interoperability scenarios • Analyze defects and support root cause investigations • Create test plans, execution reports, and release verification documentation • Support CI/CD testing activities • Participate in Agile ceremonies and sprint planning • Contribute to software quality improvements and testing best practices • Support interoperability events and validation exercises

• As a Lead Test Engineer, you will play a critical role in ensuring the quality and reliability of our software solutions. • You will work closely as part of the development team throughout the software lifecycle, embedding testing into every step of the process. • Collaborating with others in the development team to integrate testing and a quality assurance mindset into the software development lifecycle. • Define and implement structured testing practices, including automated and manual testing strategies. • Design, develop, and maintain automated test frameworks and test suites using Python and Pytest. • Develop and maintain automated front-end, backend, and API test frameworks using tools such as Cypress, Playwright, and Chai. • Perform functional, non-functional, performance, and security testing. • Ensure test processes are integrated into CI/CD pipelines for continuous quality assurance. • Optimise testing for scalability, speed, and efficiency. • Working with and supporting other Technical Leaders in project execution and timely delivery. • Collaborating with client teams.