Prolific Academic Ltd

Role Description We are seeking a Linguist - Arabic (Saudi Dialect) to act as evaluators. AI models are now learning to communicate with human-like nuance, and we need fluent speakers to ensure these models understand the depth and nuance of the Arabic language. - You will be completing side-by-side evaluations of both text and voice snippets, assessing how naturally and authentically the AI captures Arabic speech. - This includes listening to audio clips and identifying how natural the voice sounds. - This is a fast-paced project where your ear for detail directly influences how AI understands human language. - Researchers looking for your skills tend to pay between $20-26/hr. - You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Arabic language fluency: you must be a fluent Arabic speaker with a strong command of natural, everyday Arabic. - Linguistic nuance: an ability to distinguish subtle differences in accent, tone, and vocal delivery. - Communication: fluent English skills for instruction following and reporting. - Soft skills: high attention to detail; backgrounds in linguistics or translation are a plus. - Technical setup: access to a quiet environment and good quality headphones/speakers. - A PayPal account to receive payment from our clients. Requirements - Side-by-side evaluation: comparing text and voice snippets to assess quality and authenticity. - Naturalness assessment: listening to AI-generated audio and rating how natural the voice sounds. - Quality control: identifying where the AI's tone or pronunciation feels unnatural or culturally mismatched. - Contextual review: identifying whether intonation matches the cultural context of the conversation. - Data tagging: providing feedback on the naturalness, tone, and authenticity of the audio. Benefits - Chance to influence the AI models of the future using your professional expertise. - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We are seeking Translators - Arabic (Saudi Dialect) to act as evaluators. AI models are now learning to communicate with human-like nuance, and we need fluent speakers to ensure these models understand the depth and nuance of the Arabic language. - Completing side-by-side evaluations of both text and voice snippets. - Assessing how naturally and authentically the AI captures Arabic speech. - Listening to audio clips and identifying how natural the voice sounds. - This is a fast-paced project where your ear for detail directly influences how AI understands human language. - Researchers looking for your skills tend to pay between $20-26/hr. - You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Arabic language fluency: you must be a fluent Arabic speaker with a strong command of natural, everyday Arabic. - Linguistic nuance: an ability to distinguish subtle differences in accent, tone, and vocal delivery. - Communication: fluent English skills for instruction following and reporting. - Soft skills: high attention to detail; backgrounds in linguistics or translation are a plus. - Technical setup: access to a quiet environment and good quality headphones/speakers. - A PayPal account to receive payment from our clients. Requirements - Side-by-side evaluation: comparing text and voice snippets to assess quality and authenticity. - Naturalness assessment: listening to AI-generated audio and rating how natural the voice sounds. - Quality control: identifying where the AI's tone or pronunciation feels unnatural or culturally mismatched. - Contextual review: identifying whether intonation matches the cultural context of the conversation. - Data tagging: providing feedback on the naturalness, tone, and authenticity of the audio. Benefits - Chance to influence the AI models of the future using your professional expertise. - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We’re looking for JavaScript Experts to join our Expert Network to help train and evaluate cutting-edge AI models using real engineering expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $50 per hour. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Education: a BS, MS, or PhD in Computer Science, Software Engineering, or a closely related technical field. - Professional Experience: professional experience building scalable web applications using JavaScript/TypeScript. - Coding Proficiency: ability to solve LeetCode Medium to Hard-level problems in JavaScript independently. - Deep Domain Knowledge: expert understanding of the Event Loop, closures, prototypical inheritance, and asynchronous patterns (Promises, async/await). - Code Quality: a high standard for clean code, including modularity, readability, and adherence to modern ES6+ standards. - Attention to Detail: ability to spot subtle logical flaws, memory leaks, or security vulnerabilities (e.g., XSS, prototype pollution) in model-generated code. Requirements - Evaluate Code Accuracy: review AI-generated JavaScript and TypeScript code for functional correctness and adherence to best practices. - Validate Logic & Reasoning: audit the step-by-step explanations provided by AI for complex algorithmic solutions to ensure they are logically sound. - Conduct Execution Testing: execute model-generated scripts in appropriate environments (Node.js or Browser consoles) to verify performance and output. - Annotate Model Performance: identify areas where a model provides inefficient solutions, deprecated syntax, or hallucinated library methods. - Refine Technical Logic: provide structured feedback on how models reason through frontend or backend architecture discussions. Key Technologies - Core Language: expert mastery of JavaScript (ES6+) and TypeScript. - Frameworks: extensive experience with React, Node.js, Vue, or Angular. - Testing & Tools: proficiency with Jest, Cypress, Webpack, and Vite. - Backend & API: strong understanding of RESTful APIs, GraphQL, and server-side logic in a Node environment. Benefits - Chance to influence the AI models of the future using professional expertise. - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We’re looking for Biology Experts and Life Science Professionals to join our Expert Network to help train and evaluate cutting-edge AI models using real scientific expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $60 per hour. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Education: a BS, MS, or PhD in Biology, Molecular Biology, Genetics, Bioinformatics, Pharmacology, or a related Life Sciences field. - Professional Experience: years of experience in laboratory research, clinical trials, biotech, or academic instruction. - Scientific Literacy: the ability to interpret complex biological data, peer-reviewed journals, and technical protocols with high precision. - Critical Thinking: a sharp eye for identifying scientific "hallucinations," such as incorrect protein folding logic, misapplied genetic sequences, or flawed experimental designs. - Methodological Knowledge: deep understanding of the scientific method, statistical significance in biological contexts, and regulatory standards. - Communication: ability to explain intricate biological pathways or cellular mechanisms in clear, accurate technical prose. - A PayPal account to receive payment from our clients. Requirements - Evaluate AI-Generated Science: review model responses to complex biological queries for factual accuracy, reasoning, and adherence to current scientific consensus. - Fact-Check Technical Claims: validate citations from public databases (e.g., PubMed, NCBI) and ensure AI-generated summaries of research papers are accurate. - Assess Experimental Logic: critique AI-proposed experimental designs, including controls, variables, and troubleshooting steps for lab procedures. - Annotate Scientific Data: identify and correct errors in model-generated biological sequences, chemical structures, or taxonomy classifications. - Ensure Ethical Alignment: verify that AI responses regarding bioethics and sensitive biological data comply with professional and safety standards. Benefits - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We’re looking for Biology Experts and Life Science Professionals to join our Expert Network to help train and evaluate cutting-edge AI models using real scientific expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $60 per hour. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Education: a BS, MS, or PhD in Biology, Molecular Biology, Genetics, Bioinformatics, Pharmacology, or a related Life Sciences field. - Professional Experience: years of experience in laboratory research, clinical trials, biotech, or academic instruction. - Scientific Literacy: the ability to interpret complex biological data, peer-reviewed journals, and technical protocols with high precision. - Critical Thinking: a sharp eye for identifying scientific "hallucinations," such as incorrect protein folding logic, misapplied genetic sequences, or flawed experimental designs. - Methodological Knowledge: deep understanding of the scientific method, statistical significance in biological contexts, and regulatory standards. - Communication: ability to explain intricate biological pathways or cellular mechanisms in clear, accurate technical prose. - A PayPal account to receive payment from our clients. Requirements - Evaluate AI-Generated Science: review model responses to complex biological queries for factual accuracy, reasoning, and adherence to current scientific consensus. - Fact-Check Technical Claims: validate citations from public databases (e.g., PubMed, NCBI) and ensure AI-generated summaries of research papers are accurate. - Assess Experimental Logic: critique AI-proposed experimental designs, including controls, variables, and troubleshooting steps for lab procedures. - Annotate Scientific Data: identify and correct errors in model-generated biological sequences, chemical structures, or taxonomy classifications. - Ensure Ethical Alignment: verify that AI responses regarding bioethics and sensitive biological data comply with professional and safety standards. Benefits - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. - Experts who can judge the professional utility, readability, and structural integrity of design outputs. - This is a flexible, ad hoc project where your professional eye directly influences how AI understands design principles. - Researchers looking for your skills tend to pay up to 30 USD. - You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients. - Familiarity with the industry-standard stack (Figma, Adobe Photoshop, Adobe Illustrator). - Ability to distinguish between "consumer-grade" and "enterprise-ready" content. - A valid link to your portfolio or work samples is required during the screening process. Requirements - Experience in Interaction Design or Motion Graphics (bonus points). - A background in Brand Building, Advertising, or Marketing (bonus points). What you’ll be doing in the role - Evaluate two candidate designs (e.g., Google Slides, posters, or advertisements) on the same topic and determine which better meets professional standards. - Judge candidates based on specific design dimensions, including readability, text density, information hierarchy, and overall professionalism. - Review "before and after" style tasks to determine which AI output better satisfied a specific design edit or change request. - Take part in new, narrow tasks aimed at refining how AI handles concise visual communication. Important - The use of LLMs or other generative AI tools to complete the onboarding study or evaluation tasks is strictly prohibited and will result in disqualification.

Role Description We’re looking for Advanced Simplified Chinese/Mandarin Speakers to help train and evaluate cutting-edge AI models. If you have the necessary experience, we’ll send you a quick test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a Domain Expert participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay $30/hr per AI task completed. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Advanced language skills and verifiable experience as being fluent in Simplified Chinese/Mandarin. - A willingness to take our skills verification test to assess your suitability for our Domain Expert participant pool. - Strong attention to detail and the ability to concentrate on complex tasks for up to one hour at a time. - A reliable and fast internet connection and access to a computer. - A willingness to self-declare your earnings, as our participants are self-employed. - A PayPal account to receive payment from our clients. Requirements - Completing AI training tasks such as analyzing, editing, and writing in Simplified Chinese/Mandarin. - Judging the performance of AI in performing Simplified Chinese/Mandarin prompts. - Improving cutting-edge AI models. Benefits - Chance to influence the AI models of the future using professional legal expertise. - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We are seeking Fluent Tamil Speakers to act as evaluators. AI models are now learning to communicate with human-like nuance, and we need fluent speakers to ensure these models understand the cultural and emotional depth of the Tamil language. You will be assessing how well an AI model captures human emotions, intonations, and sentiments in India. This is a fast-paced project where your ear for detail directly influences how AI understands human feeling. Researchers looking for your skills tend to pay up to $24/hr. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Fluency in Tamil: you must be a fluent Tamil speaker. - Linguistic Nuance: an ability to distinguish subtle shifts in sentiment and vocal delivery. - Communication: fluent English skills for instruction following and reporting. - Soft Skills: high emotional intelligence; backgrounds in acting, therapy, or linguistics are a plus. - Technical Setup: access to a quiet environment and high-quality audio equipment (headphones/speakers). Requirements - Audio Localization: reviewing Indonesian audio clips generated by or for AI models. - Sentiment Analysis: assessing the model’s ability to convey specific emotions, intonations, and feelings. - Quality Control: identifying where the AI's "tone" feels unnatural or culturally mismatched. - Audio Assessment: listening to AI-generated or processed audio to verify "human-like" quality. - Contextual Review: identifying if the intonation matches the specific Indian cultural context of the conversation. Benefits - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We’re looking for AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $80 per hour. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning. - Professional Experience: experience building, deploying, or fine-tuning ML models in a production environment. - Deep Learning Mastery: professional-level understanding of neural network architectures (Transformers, CNNs, RNNs) and optimization techniques. - LLM Specialization: hands-on experience with Prompt Engineering, RLHF (Reinforcement Learning from Human Feedback), or RAG (Retrieval-Augmented Generation) workflows. - Technical Rigor: the ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms. - Analytical Critique: high attention to detail in spotting "hallucinations," biased outputs, or logical failures in AI-generated technical content. Requirements - Evaluate LLM Architecture Logic: review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy. - Audit Code & Notebooks: validate ML-specific code (e.g., training loops, data preprocessing scripts, or model evaluations) for efficiency and correctness. - Refine RLHF Frameworks: provide the high-quality human feedback necessary to align models with human intent, safety, and helpfulness. - Analyze Model Reasoning: critically assess how an AI model navigates complex chain-of-thought (CoT) prompts and identify where the reasoning breaks down. - Benchmark Performance: conduct comparative testing between different model outputs based on specific technical taxonomies and performance metrics. Key Technologies - Frameworks: expert proficiency in PyTorch or TensorFlow/Keras. - Language & Data: advanced Python (NumPy, Pandas, Scikit-learn) and experience with Hugging Face Transformers. - Cloud & MLOps: experience with AWS (SageMaker), Google Cloud (Vertex AI), or specialized tools like Weights & Biases and LangChain. - Vector Databases: familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation. Benefits - Competitive pay rates. - Flexible hours. - Ability to work from home.

Role Description We’re looking for AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If you have the necessary experience, we’ll send you a quick 10- to 15-minute test to assess your skills and suitability for AI tasks. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI models. Researchers looking for your skills tend to pay up to $80 per hour. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. Qualifications - Education: a BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning. - Professional Experience: experience building, deploying, or fine-tuning ML models in a production environment. - Deep Learning Mastery: professional-level understanding of neural network architectures (Transformers, CNNs, RNNs) and optimization techniques. - LLM Specialization: hands-on experience with Prompt Engineering, RLHF (Reinforcement Learning from Human Feedback), or RAG (Retrieval-Augmented Generation) workflows. - Technical Rigor: the ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms. - Analytical Critique: high attention to detail in spotting "hallucinations," biased outputs, or logical failures in AI-generated technical content. Requirements - Evaluate LLM Architecture Logic: review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy. - Audit Code & Notebooks: validate ML-specific code (e.g., training loops, data preprocessing scripts, or model evaluations) for efficiency and correctness. - Refine RLHF Frameworks: provide the high-quality human feedback necessary to align models with human intent, safety, and helpfulness. - Analyze Model Reasoning: critically assess how an AI model navigates complex chain-of-thought (CoT) prompts and identify where the reasoning breaks down. - Benchmark Performance: conduct comparative testing between different model outputs based on specific technical taxonomies and performance metrics. Key Technologies - Frameworks: expert proficiency in PyTorch or TensorFlow/Keras. - Language & Data: advanced Python (NumPy, Pandas, Scikit-learn) and experience with Hugging Face Transformers. - Cloud & MLOps: experience with AWS (SageMaker), Google Cloud (Vertex AI), or specialized tools like Weights & Biases and LangChain. - Vector Databases: familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation. Benefits - Competitive pay rates. - Flexible hours. - Ability to work from home.