Job Closed
This listing is no longer active.
Cincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.
Chemistry AI Evaluator
Location
United States
Posted
88 days ago
Salary
$73 / hour
Seniority
Mid Level
No structured requirement data.
Job Description
Chemistry AI Evaluator
Mercor
Role Description - Write and refine prompts to guide model behavior in chemistry contexts. - Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and quantitative reasoning. - Conduct fact-checking using authoritative public sources and domain knowledge. - Annotate model responses by identifying strengths, areas of improvement, and inaccuracies. - Assess clarity, structure, and appropriateness of explanations for different audiences. - Apply consistent evaluation standards by following clear taxonomies and benchmarks. Qualifications - PhD in Chemistry or a closely related field - Deep expertise in Organic & Biological Chemistry, Inorganic & Materials Chemistry, Physical & Theoretical Chemistry, or Analytical & Instrumental Chemistry - Significant experience using large language models (LLMs) - Excellent writing skills and strong attention to detail - Experience reviewing or editing technical or academic writing - Prior experience with RLHF, model evaluation, or data annotation work (Preferred) - Experience teaching or explaining chemistry concepts to non-expert audiences (Preferred) - Familiarity with evaluation rubrics or structured review frameworks (Preferred) Company Description Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Job Requirements
- PhD in Chemistry or a closely related field
- Deep expertise in Organic & Biological Chemistry, Inorganic & Materials Chemistry, Physical & Theoretical Chemistry, or Analytical & Instrumental Chemistry
- Significant experience using large language models (LLMs)
- Excellent writing skills and strong attention to detail
- Experience reviewing or editing technical or academic writing
- Prior experience with RLHF, model evaluation, or data annotation work (Preferred)
- Experience teaching or explaining chemistry concepts to non-expert audiences (Preferred)
- Familiarity with evaluation rubrics or structured review frameworks (Preferred)
Related Guides
Related Job Pages
More AI Research Scientist Jobs
• Conduct original research on learning, distributed inference, and trustless collaboration in AI systems • Contribute to the design of incentive mechanisms that support open and community-driven AI networks • Prototype experimental systems and communicate findings internally and externally • Translate theoretical insights into practical designs with engineering collaborators • Engage with the global research community in AI, ML systems, and applied cryptography
• Design and implement protocols for AI training and inference (e.g. federated learning, distributed fine-tuning, secure model serving) • Build scalable systems to support AI workloads across heterogeneous networks and devices • Contribute to architectural decisions, performance optimization, and reliability engineering • Collaborate with researchers and system engineers to translate novel ideas into real-world systems • Stay current with the latest advancements in AI, distributed infrastructure, and cryptographic mechanisms
Senior AI Scientist
Covera HealthUsing advanced clinical analytics, we're changing how quality healthcare is defined, measured, and delivered.
• Create AI algorithms that will be deployed to reduce misdiagnosis in radiology and improve patient care • Investigate, develop and evaluate new AI methods to improve Covera’s understanding of radiology reports and images • Drive innovation and publications and represent Covera Health at scientific and industry conferences • Collaborate with data science, clinical and engineering team members to help us build and deploy our clinical research roadmap • Mentor junior researchers and drive AI development processes • Be passionate about improving patient care using AI • Play an active role in further building the Covera team by joining interview panels and contributing to cross-company projects after onboarding
AI Scientist
Covera HealthUsing advanced clinical analytics, we're changing how quality healthcare is defined, measured, and delivered.
• Create AI algorithms that will be deployed to reduce misdiagnosis in radiology and improve patient care • Investigate, develop and evaluate new AI methods to improve Covera’s understanding of radiology reports and images • Drive innovation and publications and represent Covera Health at scientific and industry conferences • Collaborate with data science, clinical and engineering team members to help us build and deploy our clinical research roadmap • Be passionate about improving patient care using AI • Play an active role in further building the Covera team by joining interview panels and contributing to cross-company projects after onboarding
