Job Closed

This listing is no longer active.

Mercor logo
Mercor

Cincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.

AI Model Evaluator

Research ScientistResearch ScientistOtherRemoteMid LevelH1B No Sponsor

Location

United States + 1 moreAll locations: United States | Malaysia

Posted

75 days ago

Salary

$36 / hour

Seniority

Mid Level

No structured requirement data.

Job Description

AI Model Evaluator

Mercor

Role Description Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: AI Model Evaluator Type: Full-time or Part-time Contract Work Compensation: $36/hour Location: Geography restricted to Taiwan, Malaysia, USA Role Responsibilities - Evaluate LLM-generated responses for effectiveness in answering user queries. - Conduct fact-checking using trusted public sources and external tools. - Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies. - Assess reasoning quality, clarity, tone, and completeness of responses. - Ensure model responses align with expected conversational behavior and system guidelines. - Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines. Qualifications - Must-Have: - Bachelor’s degree - Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Chinese (Mandarin) - Significant experience using large language models (LLMs) - Excellent writing skills - Strong attention to detail - Adaptable and comfortable moving across topics, domains, and customer requirements - Background or experience in domains requiring structured analytical thinking - Excellent college-level mathematics skills - Preferred: - Prior experience with RLHF, model evaluation, or data annotation work - Experience writing or editing high-quality written content - Experience comparing multiple outputs and making fine-grained qualitative judgments - Familiarity with evaluation rubrics, benchmarks, or quality scoring systems Application Process - Upload resume - AI interview based on your resume - Submit form Resources & Support - For details about the interview process and platform information, please check: Interview Process Details - For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Requirements

  • Must-Have:
  • Bachelor’s degree
  • Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Chinese (Mandarin)
  • Significant experience using large language models (LLMs)
  • Excellent writing skills
  • Strong attention to detail
  • Adaptable and comfortable moving across topics, domains, and customer requirements
  • Background or experience in domains requiring structured analytical thinking
  • Excellent college-level mathematics skills
  • Preferred:
  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments
  • Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
  • Application Process
  • Upload resume
  • AI interview based on your resume
  • Submit form
  • Resources & Support
  • For details about the interview process and platform information, please check: Interview Process Details
  • For any help or support, reach out to: support@mercor.com
  • PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Related Categories

Related Job Pages

More Research Scientist Jobs

OtherRemoteTeam 501-1,000

Who We Are: A Mission Driven Company​​ Novavax has a rich history of innovation to help eradicate disease, prevent serious illness and save lives. But there is still work to be done. Our people are passionate about the mission and vision that guide our work.​​ Job Description We are seeking multiple highly motivated temporary employees to support cutting-edge research at the intersection of computational biology, artificial intelligence, and vaccine discovery. These positions offer a unique opportunity to be mentored by Novavax scientists while contributing to the computational design and experimental assessment of novel protein antigens by leveraging the latest advances in large language models (LLMs), GPT-based systems, and AI-driven protein engineering. The contractors will work closely with a multidisciplinary team of computational scientists and experimental biologists to accelerate next-generation vaccine antigen discovery. Key Responsibilities - Assist in the computational design of novel protein antigens for vaccine research. - Apply and evaluate emerging AI/ML approaches, including large language models (LLMs) and GPT-based tools, for protein sequence and structure design. - Support experimental assessment and analysis of designed protein antigens in collaboration with laboratory teams. - Analyze and interpret computational and experimental data; document results and insights. - Contribute to internal reports, presentations, and project discussions. - Stay informed on recent advances in AI-driven protein design and computational biology. Required Qualifications - Currently enrolled as a full-time undergraduate (Bachelors, B.S.) or Master’s student at a U.S. university during Summer 2026. - Major field of study should be in Computer Science, Biology, Computational Biology, Bioinformatics, or a closely related field. - Completion of at least 25% of required academic credits toward the degree program. - Strong interest in vaccine research, protein design, or AI applications in biology. - Basic proficiency in at least one programming language (e.g., Python, R, or similar). - Ability to work independently and collaboratively in a research-focused environment. Preferred Qualifications - Coursework or experience in machine learning, deep learning, or AI. - Familiarity with protein biology, structural biology, or bioinformatics tools. - Experience with data analysis, scientific computing, or cloud-based workflows. - Prior exposure to LLMs, GPTs, or generative models applied to scientific problems. Position Details - Schedule: Full-time during 3 month Summer Research Program - Work Location: Flexible – remote or on-site at Gaithersburg, Maryland. - Mentorship: Direct mentorship from experienced researchers in computational and experimental vaccine science. - Learning Opportunity: Hands-on exposure to real-world applications of AI and biology in an industry research setting. The annual base salary (or hourly wage) for this position falls within the range of $20.90 - $26.15. However, the actual base pay offered may vary based on several individualized factors, such as market location, job-related knowledge, skills, and experience. Novavax offers a base salary, annual bonus, equity grants, professional career development/growth opportunities, and a comprehensive benefits package including medical, dental, vision, Rx, STD, LTD, Life, Optional Life, 401(k) plan. Our Mission​​ By leveraging our science, our technology and our people, we will innovate and collaborate to tackle the world’s most significant health challenges.​​ Our Vision​​ We envision a world where our technology is amplified to touch the lives of billions, sparking transformation in global health.​​ Our Values​​ Integrity, Collaboration, Innovation, Agility and Accountability sit at the heart of our culture. They express the mindset and behaviors that guide how we show up, how we work together and how we create impact — for patients, partners and each other. ​​ Our Footprint ​​ Novavax is proudly headquartered in the USA with main offices in Gaithersburg, Maryland. We conduct R&D and manufacturing for our Matrix-M adjuvant in Uppsala, Sweden.​

United States
$21 - $26 / hour
Job Closed
IQVIA logo

Principal Biostatistician FSP, Phase 1 to 3 Safety

IQVIA

Accelerate innovation for a healthier world.

OtherRemoteTeam 10,001+H1B Sponsor

Job Level: FSP Principal Biostatistician, Late Phase Location: Home-based in the U.S. or Canada Why DSSS? Data Sciences Staffing Solutions, DSSS, is a unit within IQVIA that provides our sponsors with fully embedded resources through a Functional Service Provider (FSP) partnership. This yields all the benefits of working for an industry leading global CRO and collaborating directly with cross-functional sponsor teams. Sponsor clients include world class pharmaceutical and biotech companies offering you unique opportunities to influence the future of medicine and advance therapies to market. Job Summary: The Principal Biostatistician is responsible for providing statistical support for pharmaceutical clinical trials in patients. Additional Benefits: - Home-based remote working opportunities. - Work/life balance as well as flexible schedules. - Collaborating with motivated, high-performance, statistical and research teams. - Technical training and tailored development curriculum. - Research opportunities that match your unique skillset. - Promising career trajectory. - Job stability: long-term engagements and re-deployment opportunities. - Focus on bringing new therapies to market rather than project budgets and change orders. - Experience with regulatory submissions. - Engaging, fast-paced environment. - Good work-life balance. Job Responsibilities: - Collaborate with multi-disciplinary project teams to establish project objectives and timelines. - Write the statistical sections of clinical trial protocols, while consulting with internal and external experts. - Author statistical analysis plans. - Monitor internal and CRO project activities including timelines, deliverables, and availability of resources. - Collaborate with Data Management, Clinical Development, and Clinical Operations with statistical expertise. - Contribute to clinical study reports and other regulatory documents, e.g. NDA, DSURs, Briefing Documents, ISS, ISE, etc. - Provide guidance and supervision to programmers in authoring of analysis dataset specifications and programming/validation of tables, listings, and figures. - Interpret study results and review reports of study results for accuracy. - Support exploratory analyses. - Participate in pre-IND or NDA activities. - Participates in other activities and meetings to support Biostatistics and the Development Team as needed. Qualifications (Minimal acceptable level of education, work experience, and competency) - PhD in Statistics, Biostatistics, or related field with 5+ years industry experience. - MS in Statistics, Biostatistics, or related field with 7+ years of industry experience. - At least 3 years in Phase 2/3 clinical trial experience. - Demonstrated ability to work pro-actively and independently. - Able to effectively communicate his/her ideas and to manage programmers in a constructive manner. - Ability to use R or SAS to perform efficacy and safety analyses and validate important data derivations when necessary. - Understanding of ICH GCP, ICH E9 plus general knowledge of industry practices and standards. - Experience with CDISC, including SDTM, ADAM, CDASH Desired Experience: - Interaction with regulators including Advisory Committee meetings. - 2+ years of experience with renal therapeutic area. #LI-Remote #LI-NITINMAHAJAN IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com IQVIA is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other status protected by applicable law. https://jobs.iqvia.com/eoe IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism. The potential base pay range for this role, when annualized, is $96,400.00 - $294,800.00. The actual base pay offered may vary based on a number of factors including job-related qualifications such as knowledge, skills, education, and experience; location; and/or schedule (full or part-time). Dependent on the position offered, incentive plans, bonuses, and/or other forms of compensation may be offered, in addition to a range of health and welfare and/or other benefits.

United States
$96.4K - $294K / year
Job Closed
ŌURA logo

Behavioral Scientist

ŌURA

Better lives through better sleep.

OtherRemoteTeam 201-500H1B No Sponsor

Our mission at Oura is to empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped millions of people understand and improve their health by providing daily insights and practical steps to inspire healthy lifestyles. Empowering the world starts with living our values and empowering our team. As a quickly growing company focused on helping people live healthier and happier lives, we ensure that our team members have what they need to do their best work — both in and out of the office. We are looking for a Behavioral Scientist to join our Research & Development team. The Behavioral Science team has a dual mission: - to develop new behavioral models, measurement approaches, and research foundations that power AI-driven health guidance, and - to partner closely with product squads to translate behavioral science into impactful, member-facing experiences. In this role, you will operate across both domains, helping build behavioral capabilities (such as modeling motivational states, readiness for change, and support needs) as well as collaborating with squads like Women’s Health and Activity to shape real-world product experiences. You will work at the intersection of behavioral science, AI, and product development to ensure Oura’s expanding product offering delivers personalized, culturally-aware, and actionable health support at scale. This is a remote US role, with a preference for Central and East Coast locations (New York, Boston, Chicago). We have offices in San Francisco, San Diego and Los Angeles for those who prefer hybrid or office settings. Oura employees in other major cities (like Boston and New York) occasionally gather informally at local co-working locations. What you will do Behavioral Capability Development - Contribute to the development of behavioral models that capture motivational states, readiness for change, and user needs. - Partner with data science and engineering to operationalize psychological constructs into measurable product signals. - Help integrate behavioral science principles into adaptive AI-forward strategies, including tone, timing, and framing based on inferred user context. - Contribute to measurement frameworks that evaluate behavioral impact across features and markets. Product & Squad Partnership - Collaborate with product squads to design and refine behavior change support aligned with member needs. - Translate evidence and research insights into actionable product recommendations. - Support culturally sensitive adaptation of behavioral strategies as Oura expands globally. Requirements We would love to have you on our team if you have: - A PhD in Behavioral Science, Psychology, Human-Computer Interaction, Health Informatics, or a related field (or Master’s with 3+ years relevant experience). - Experience applying behavioral science within digital health or AI-enabled products. - Experience operationalizing psychological constructs (e.g., motivation, self-regulation, readiness for change) into measurable or system-level components. - Strong qualitative and quantitative research skills. - Experience collaborating with multidisciplinary product teams. - Proficiency in Python, R, or SQL. - Experience in culturally-informed behavior change and global health contexts. Benefits At Oura, we care about you and your well-being. Everyone here at Oura has a ring of their own, and we are continually looking to improve employee health. What we offer: - Competitive salary and equity packages - Health, dental, vision insurance, and mental health resources - An Oura Ring of your own plus employee discounts for friends & family - 20 days of paid time off plus 13 paid holidays plus 8 days of flexible wellness time off - Paid sick leave and parental leave Oura takes a market-based approach to pay, which may vary depending on your location. US locations are categorized into tiers based on a cost of labor index for that geographic area. While most offers will be closer to the starting range, successful candidates’ pay will be determined based on job-related skills, experience, qualifications, work location, internal peer equity, and market conditions. These ranges may be modified in the future. - Region 1 $151,300 –$178,000 - Region 2 $138,550 – $163,000 - Region 3 $127,500 – $150,000 A recruiter can determine your zones/tiers based on your US location. We are not considering candidates residing in the following states: Alaska (AK), Delaware (DE), Iowa (IA), Mississippi (MS), Nebraska (NE), South Dakota (SD), Vermont (VT), West Virginia (WV), and Wisconsin (WI). Oura is proud to be an equal opportunity workplace. We celebrate diversity and are committed to creating an inclusive environment for all employees. Individuals seeking employment at Oura are considered without regard to age, ancestry, color, gender (including pregnancy, childbirth, or related medical conditions), gender identity or expression, genetic information, marital status, medical condition, mental or physical disability, national origin, protected family care or medical leave status, race, religion (including beliefs and practices or the absence thereof), sexual orientation, military or veteran status, or any other characteristic protected by federal, state, or local laws. We will not tolerate discrimination or harassment based on any of these characteristics. We will work to ensure individuals with disabilities are provided reasonable accommodation to participate in the interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Disclaimer: Beware of fake job offers! We’ve been alerted to scammers posing as ŌURA recruiters, especially for remote roles. Please note: - Our jobs are listed only on the ŌURA Careers page and trusted job boards. - We will never ask for personal information like ID or payment for equipment upfront. - Official offers are sent through Docusign after a verbal offer, not via text or email. Stay cautious and protect your personal details. To all recruitment agencies: Oura does not accept agency resumes. Please do not forward resumes to our jobs alias, Oura employees, or any other organization's location. Oura is not responsible for any fees related to unsolicited resumes.

United States
$127K - $178K / year
Job Closed
Cogstate logo

Principal Scientist

Cogstate

Simplifying brain health measurement.

OtherRemoteTeam 51-200Since 1999H1B No Sponsor

• Oversee the delivery of specific scientific project services. • Contribute to the definition of study specific delivery plans and processes. • Provide directions to internal study team staff with respect to feasibility, process, timing of delivery of services. • Be accountable for study scientific decisions, and for ensuring clarity of internal and external project communications. • Ensure accurate tracking of time spent on studies. • Work collaboratively with the Head of Project Management to develop tracking and control mechanisms to ensure profitable delivery of rater training services. • Contribute to staff development and management of the Rater Training Group: training, definition of goals, and performance assessments. • Contribute to the definition of central, standard and efficient delivery processes. • Development of pragmatic quality control procedures that ensure the quality of delivery of services. • Contribute to the development of SOPs and Guidelines. Answering internal staff and sponsor questions. • Evaluate proposed raters against rater experience criteria. • Conduct live rater training sessions. • Conduct rater remediation training sessions. • Collect psychometric and interview data for non-interventional studies. • Interact with sponsors to resolve scientific queries and participate in study planning. • Conduct standardized clinical outcome assessments remotely or in a centralized setting for pediatric and rare disease clinical trials. • Ensure adherence to study protocols, assessment guidelines, and regulatory requirements while administering measures. • Maintain inter-rater reliability and scoring accuracy through rigorous training and periodic calibration. • Review and evaluate completed assessments from site-based raters for accuracy, consistency, and adherence to study protocols. • Identify and address scoring discrepancies, potential data quality issues, and protocol deviations. • Create business requirements documents and provide overview of DBCM and RPCM dashboards with sponsors. • Support the development of new products and services. • Support cognition research. • Support collection and analysis of data related to rater performance for improving services. • Design and interpret metrics for tracking product or service delivery performance. • Supporting sales. • Drive publications and presentations at conferences of results of scientific and operational data from clinical trials and other studies.

United States
$145K - $160K / year
Job Closed