Role Description - Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness. - Conduct fact-checking using trusted public sources and authoritative references. - Execute code and validate outputs using appropriate tools to ensure accuracy. - Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies. - Assess code quality, readability, algorithmic soundness, and explanation quality. - Ensure model responses align with expected conversational behavior and system guidelines. - Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines. Qualifications - BS, MS, or PhD in Computer Science or a closely related field - 5+ years of real-world experience in software engineering or related technical roles - Expertise in at least two relevant programming languages (e.g., Python, Java, C++, JavaScript, Go, Rust, Ruby, SQL, Powershell, Bash, Swift, Kotlin, R, TypeScript, HTML/CSS) - Ability to solve HackerRank or LeetCode Medium and Hard-level problems independently - Experience contributing to well-known open-source projects, including merged pull requests - Significant experience using LLMs while coding and understanding their strengths and failure modes - Strong attention to detail and comfort evaluating complex technical reasoning, identifying subtle bugs or logical flaws Requirements - Prior experience with RLHF, model evaluation, or data annotation work (Preferred) - Track record in competitive programming (Preferred) - Experience reviewing code in production environments (Preferred) - Familiarity with multiple programming paradigms or ecosystems (Preferred) - Experience explaining complex technical concepts to non-expert audiences (Preferred) Benefits - Compensation: $60–$100/hour - Type: Full-time or Part-time Contract Work - Location: Remote Application Process - Upload resume - AI interview based on your resume - Submit form Resources & Support - For details about the interview process and platform information, please check: Interview Process - For any help or support, reach out to: support@mercor.com - PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Role Description - Design challenging, real-world STEM problems to evaluate model reasoning and problem-solving. - Implement tasks using Python in an agentic development environment. - Analyze model/agent behavior to diagnose reasoning gaps and improve performance. - Develop reproducible and testable deliverables with clear specifications and deterministic tests. - Collaborate with AI research teams to enhance model outputs and training data quality. - Work independently and asynchronously to meet deadlines and project goals. Qualifications - Deep expertise in data science, machine learning, finance, and/or Python-based coding. - Active or recently graduated PhD (Top 20 U.S.-based school). - Strong research background in frontier STEM topics. - Ability to engage reliably for 30+ hours/week, primarily on weekdays. - Demonstrated technical output such as high-quality open-source contributions. - Comfort reading and reasoning about agent behavior traces to diagnose failure modes. Requirements - Familiarity with agentic frameworks and OSS ecosystems like LangChain, MetaGPT, AutoGen, AutoGPT, CrewAI, LlamaIndex, BabyAGI, SuperAGI, CAMEL, AgentGPT, Dify. Benefits - Compensation: $50–$100/hour - Commitment: 30+ hours/week Application Process - Upload resume - AI interview based on your resume - Submit form Resources & Support - For details about the interview process and platform information, please check: Interview Process - For any help or support, reach out to: support@mercor.com

Role Description - Apply expertise in statistics, machine learning, and programming to enhance AI model training and improve model outputs. - Leverage computer vision, feature extraction, and machine learning algorithms to drive content "shareability" on social media platforms. - Design and evaluate predictive models using a flexible, analytical approach for optimal data value extraction. - Collaborate with product engineers to translate prototypes into scalable products and features. - Provide Business Intelligence and data visualization support for customer service dashboards and ad-hoc data analysis requests. - Conduct metric movement investigations for key recommendation products and prepare weekly leadership reports. Qualifications - Master’s degree in Mathematics, Statistics, or a relevant technical field; PhD preferred. - 5+ years of work experience in analytics. - Fluency with SQL and Python. - Experience with PyTorch or TensorFlow libraries. - Experience training and using computer vision models. - Strong written communication skills for conveying complex information. - Experience working with large datasets. Requirements - Hourly contractor, Paid weekly. Application Process - Upload resume. - AI interview based on your resume. - Submit form. Resources & Support - For details about the interview process and platform information, please check: Interview Process Details . - For any help or support, reach out to: support@mercor.com .

• Communicate with business stakeholders to understand goals and translate them into robust ML/AI models to improve clinical outcomes for children. • Work with Data Science and other cross functional teams to define requirements, optimize data collection, build data assets, and deliver insights on business strategy and patient care • Develop ML models incorporating clinical, claims, and social determinants of health (SDoH) data to drive actionable recommendations • Define and maintain logging, monitoring, and alerting for models such as evaluation metrics, hyperparameters, and drift • Independently query Snowflake and prepare data for exploratory data analysis and modeling • Create clean, maintainable code and own the model development lifecycle