The potential of every professional. The promise of every industry.
Lead Specialist, AI Scientist
Location
Spain
Posted
87 days ago
Salary
0
Seniority
Senior
Job Description
Lead Specialist, AI Scientist
Pearson VUE
• Design, build, and improve speech language models for spoken response understanding, pronunciation analysis, fluency, prosody, and communicative effectiveness. • Develop and evaluate automated scoring and feedback pipelines for speaking tasks used in: • AI‑driven speaking practice with instant feedback (learner‑facing). • Job‑relevant oral communication and soft‑skills assessments (hiring‑facing). • Train, fine‑tune, and evaluate acoustic models, cascading models, speech-to-speech models, speech LMs, and scoring models, including neural and large language model–based approaches. • Design experiments and conduct quantitative performance, reliability, and validity analyses to ensure assessment quality and decision integrity. • Work across a range of speaking constructs such as interactional competence, pragmatic competence, spoken critical thinking skills etc. • Perform detailed error analysis, intra- and inter-agent rater reliability studies on ASR outputs, spoken features, and scoring behaviors to guide model and product improvements. • Collaborate with product, UX, and assessment scientists to integrate models into interactive experiences such as practice simulations, and hiring workflows. • Apply responsible AI principles to speech systems, including fairness across accents, dialects, and proficiency levels, as well as transparency of feedback and scores. • Support model monitoring and governance in production environments, ensuring ongoing quality and compliance for high‑stakes use cases. • Act as the technical lead for an AI conversational assessment product, partnering closely with a Product Manager to translate assessment goals, user needs, and business constraints into model and system design decisions. • Shape end‑to‑end conversational assessment design (task structure, prompts, turn‑taking, scoring logic, feedback timing) in collaboration with product and assessment stakeholders. • Balance assessment validity, user experience, system latency, and scalability when making model and system design trade‑offs for production conversational assessments.
Job Requirements
- Master’s or PhD in Computer Science, Electrical Engineering, Speech & Language Processing, Applied Linguistics, Language Assessment, or equivalent applied experience.
- Hands‑on experience building speech recognition, spoken language understanding, or automated scoring systems.
- Strong programming skills in Python, with experience using PyTorch or similar ML frameworks for speech and language modeling.
- Solid grounding in machine learning, statistics, and experimental design, especially as applied to model evaluation.
- Experience with modern neural speech models and large language models, including fine‑tuning and evaluation for spoken tasks.
- Expertise in model evaluation metrics relevant to speech and assessment (accuracy, reliability, validity, fairness).
- Familiarity with responsible AI practices, including bias analysis, interpretability, and governance for user‑impacting systems.
- Strong communication skills, with the ability to explain model behavior and assessment outcomes to technical and non‑technical stakeholders.
- Experience working in cross‑functional product teams, contributing to roadmap decisions, and shipping ML systems into production.
Related Guides
Related Job Pages
More AI Research Scientist Jobs
Investment Banking & Capital Markets — AI Residency
ApturaAptura works with leading foundational AI labs to bring institutional finance expertise directly into AI model development. Founded by ex-Lazard and Partners Group professionals, we operate from London and San Francisco.
About Us Mentis AI works at the intersection of institutional finance expertise and frontier AI systems. Our team combines deep financial services experience (Lazard, Partners Group) with machine learning and applied AI research. Operating across London and San Francisco, we collaborate with leading AI labs to improve how models reason, generalize, and make decisions in high-stakes financial contexts. The Opportunity This residency is designed for senior research analysts and portfolio managers who want exposure and a meaningful experience towards the direction of AI in your domain and earn early, practical exposure at using advanced AI system. You will: - Prompt: Develop and iterate realistic prompts that you would ask a junior role to test the relevance and quality of AI-generated insights. - Compare human vs. machine judgment: Systematically evaluate divergence between professional banking judgment and AI outputs across M&A, ECM, DCM, and leveraged finance contexts. - Design frameworks: Translate how senior bankers evaluate transactions, structure deals, and advise clients through origination, execution, and close into problems that push the limits of AI reasoning. - Construct expert benchmarks: Build and validate real-world transaction analyses, valuation frameworks, and deal materials used to evaluate frontier AI systems Why This Experience Is Valuable - Hands-on exposure to how AI is reshaping deal workflows, from pitching and origination through financial modeling, fairness opinions, and transaction close. - You will be among the first investment banking professionals to work directly on how frontier AI models reason about transaction structuring, valuation, and capital markets execution. Who You Are - 3–7 years of experience in investment banking or capital markets at a bulge bracket or elite boutique (e.g. Goldman Sachs, Morgan Stanley, J.P. Morgan, Bank of America, Citi, Barclays, UBS, Deutsche Bank, Wells Fargo, Evercore, Moelis, Centerview, Lazard, Jefferies) - Associate, VP, or Director level across M&A, industry coverage, ECM/DCM, leveraged finance, or syndicate - Deep expertise in at least one of: M&A deal structuring and valuation, equity or debt capital markets execution, sector-specific coverage, or syndicate/book-running - Strong financial modeling skills (including LBO, 3-statement, DCF) and comfort with complex transaction analysis, fairness opinions, and client-facing materials - Ability to articulate investment banking judgment clearly and precisely in writing - Genuine intellectual curiosity about the application of AI in financial services Residency Structure - Commitment: 15+ hours/week, flexible scheduling - Location: Remote globally, or in-person if based in London - Compensation: Hourly rate depending on experience - Start date: Immediate / Rolling
Investment Banking & Capital Markets — AI Residency
ApturaAptura works with leading foundational AI labs to bring institutional finance expertise directly into AI model development. Founded by ex-Lazard and Partners Group professionals, we operate from London and San Francisco.
About Us Mentis AI works at the intersection of institutional finance expertise and frontier AI systems. Our team combines deep financial services experience (Lazard, Partners Group) with machine learning and applied AI research. Operating across London and San Francisco, we collaborate with leading AI labs to improve how models reason, generalize, and make decisions in high-stakes financial contexts. The Opportunity This residency is designed for senior research analysts and portfolio managers who want exposure and a meaningful experience towards the direction of AI in your domain and earn early, practical exposure at using advanced AI system. You will: - Prompt: Develop and iterate realistic prompts that you would ask a junior role to test the relevance and quality of AI-generated insights. - Compare human vs. machine judgment: Systematically evaluate divergence between professional banking judgment and AI outputs across M&A, ECM, DCM, and leveraged finance contexts. - Design frameworks: Translate how senior bankers evaluate transactions, structure deals, and advise clients through origination, execution, and close into problems that push the limits of AI reasoning. - Construct expert benchmarks: Build and validate real-world transaction analyses, valuation frameworks, and deal materials used to evaluate frontier AI systems Why This Experience Is Valuable - Hands-on exposure to how AI is reshaping deal workflows, from pitching and origination through financial modeling, fairness opinions, and transaction close. - You will be among the first investment banking professionals to work directly on how frontier AI models reason about transaction structuring, valuation, and capital markets execution. Who You Are - 3–7 years of experience in investment banking or capital markets at a bulge bracket or elite boutique (e.g. Goldman Sachs, Morgan Stanley, J.P. Morgan, Bank of America, Citi, Barclays, UBS, Deutsche Bank, Wells Fargo, Evercore, Moelis, Centerview, Lazard, Jefferies) - Associate, VP, or Director level across M&A, industry coverage, ECM/DCM, leveraged finance, or syndicate - Deep expertise in at least one of: M&A deal structuring and valuation, equity or debt capital markets execution, sector-specific coverage, or syndicate/book-running - Strong financial modeling skills (including LBO, 3-statement, DCF) and comfort with complex transaction analysis, fairness opinions, and client-facing materials - Ability to articulate investment banking judgment clearly and precisely in writing - Genuine intellectual curiosity about the application of AI in financial services Residency Structure - Commitment: 15+ hours/week, flexible scheduling - Location: Remote globally - Compensation: Hourly rate depending on experience - Start date: Immediate / Rolling
Senior Generative AI Scientist
CotivitiFounded in 1979, Cotiviti provides analytics-driven payment and network solutions for the healthcare and retail industries, offering services that help payers,
• Delivering solutions that help our clients identify payment integrity issues, reduce the cost of healthcare processes, or improve the quality of healthcare outcomes • Work as part of a team and be individually responsible for the delivery of value associated with your projects • Follow processes and practices that allow your models to be incorporated into our machine learning platform for production execution and monitoring • Develop an exploratory data analysis approach to verify the initial hypothesis associated with potential Artificial Intelligence/Machine Learning use cases • Document your approach, thinking and results in standard approaches to allow other data scientists to collaborate with you on this work • Prepare your final trained model and develop a validation test set for QA • Work with ML Ops/Production operations to deploy your model into production and support them in monitoring model performance • Participate in design sessions to continuously develop and improve the Cotiviti machine learning platform • Participate in other data science initiatives, collaborating with your peers to support their projects • Participate in knowledge sharing sessions to bring new insights and technologies to the team • Provide End to End value-based solutions, including data pipeline, model creation and application for end user consumption
AI Researcher
MercorCincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.
Role Description - Author original computer science questions that test deep conceptual understanding, not surface-level recall. - Ensure questions are unambiguous, self-contained, and precisely defined with all necessary information in the problem statement. - Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). - Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers. - Write step-by-step Chain-of-Thought solutions with clear, concise intermediate steps in markdown format. - Supply 1–5 academic references per question from reputable sources like peer-reviewed journals or university repositories. - For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made. Qualifications - Must-Have: PhD or doctoral candidate in Computer Science, Electrical Engineering, or a closely related field. - Master's degree considered for candidates with exceptional depth in a specific subdomain. - Strong command of graduate-level CS theory, algorithms, systems design, and/or machine learning. - Excellent written English and ability to express complex ideas clearly and concisely. - Preferred: Research publications, industry experience at top tech companies, or competitive programming background. Requirements - Contract position. - Compensation: $35–$75/hour. - Location: Remote. - Commitment: 10+ hours/week. Company Description Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.


