Appen is your trusted data partner, powering cutting-edge AI applications for the world's most innovative companies.
Bilingual AI Language Evaluator, Slovenian
Location
United States
Posted
1 day ago
Salary
$11 / hour
Seniority
Senior
Job Description
Bilingual AI Language Evaluator, Slovenian
Appen
• Write prompts in your native language designed to test an AI model. • Evaluate the AI's responses using a structured rating guide. • Identify areas where the AI's responses can be improved. • Translate your prompts and evaluations into English.
Job Requirements
- Native-level fluency in Slovenian
- Professional-level proficiency in English (bilingual is required).
- Strong written communication skills.
- Ability to provide accurate English translations.
Benefits
- Flexible schedule
- Work remotely from home
Related Guides
Related Categories
Related Job Pages
More Artificial Intelligence Jobs
AI Consultant – GenAI
SpyrosoftWe enable our clients to thrive, thanks to a combination of technical proficiency and domain-specific knowledge.
• Partner with customers to understand their business goals, challenges and technology landscape • Lead AI discovery workshops, technical assessments and solution design sessions • Identify high-impact AI use cases and evaluate their business value and technical feasibility • Assess existing systems, architecture and engineering capabilities to determine AI readiness • Recommend AI solutions, implementation approaches and technology roadmaps tailored to customer needs • Translate business objectives into clear technical strategies and delivery plans • Collaborate with AI Engineers, Solution Architects, Data Engineers and business stakeholders throughout the engagement • Support pre-sales activities, customer presentations and technical demonstrations • Provide trusted technical guidance throughout the AI adoption journey • Stay up to date with emerging AI technologies, industry trends and best practices
Role Description Join an advanced AI research initiative focused on improving how next-generation AI systems understand professional documents, execute complex instructions, and reason through real-world technical workflows. We are seeking experienced technology professionals to design high-quality benchmark tasks that evaluate AI performance across software engineering and data science domains. In this role, you will create realistic, multi-step evaluation tasks based on technical documentation, code repositories, API references, architecture diagrams, and other workplace resources. Your work will help measure and improve the ability of AI models to interpret technical information, follow detailed instructions, and generate accurate, well-structured outputs. This is a fully remote, independent contractor opportunity with flexible working hours. Key Responsibilities - Design AI Evaluation Tasks - Create realistic, multi-step benchmark tasks based on professional technology workflows. - Develop challenges using technical specifications, architecture documents, API documentation, codebases, web research, and code execution. - Ensure each task includes a clearly defined expected output and objective evaluation criteria. - Develop Evaluation Standards - Write comprehensive ground-truth solutions and structured scoring rubrics. - Design tasks that assess reasoning, technical understanding, instruction following, and output quality. - Maintain high standards of technical accuracy, clarity, and reproducibility. - Contribute Domain Expertise - Apply real-world knowledge from software engineering, data science, or analytics to create authentic evaluation scenarios. - Collaborate with research teams to improve benchmark quality and consistency. - Continuously refine tasks based on project feedback and evolving evaluation requirements. Qualifications - Minimum 3 years of hands-on professional experience in one or more of the following areas: - Software Engineering - Data Science - Data Analytics - Strong understanding of technical documentation, software development workflows, and engineering best practices. - Experience working with codebases, APIs, technical specifications, or system architecture documentation. - Excellent analytical thinking and problem-solving skills. - Strong written communication with the ability to create clear technical instructions and evaluation criteria. - Ability to work independently while maintaining high standards of accuracy and consistency. Engagement Details - Independent contractor engagement. - Fully remote with flexible working hours. - Expected commitment of 15–20 hours per week. - Projects may be extended, shortened, or concluded based on business needs and performance. - Weekly payments processed through supported payment platforms. Why Join - Help shape the next generation of AI systems for technical reasoning and document understanding. - Work on intellectually challenging projects involving real-world engineering and data science workflows. - Apply your technical expertise to improve advanced AI evaluation benchmarks. - Enjoy flexible remote work with meaningful impact on AI research. Equal Opportunity Statement We are committed to providing equal opportunities to all qualified applicants without regard to legally protected characteristics. Reasonable accommodations are available upon request. Contract Information - Independent contractor engagement. - Fully remote work completed on your own schedule. - Weekly payments are processed based on approved work completed. - Work does not involve access to confidential or proprietary information from any employer, client, or institution. - Please note that visa sponsorship is not available for this opportunity.
Role Description Join an innovative AI research initiative focused on developing next-generation text-to-speech (TTS) systems capable of producing natural, expressive, and human-like voices. We are seeking experienced voice professionals with authentic Southern American English accents to contribute high-quality voice recordings used to train and evaluate advanced speech generation models. This opportunity is ideal for voice actors, narrators, broadcasters, and other audio professionals who can consistently deliver clear, engaging, and emotionally expressive performances across a variety of scripts. Important: Voice recordings will be used exclusively to support an internal customer experience (CX) AI agent. Recordings will not be sold, licensed, or repurposed for unrelated products or datasets. Key Responsibilities - Record Professional Voice Samples - Record high-quality audio across a variety of script types, including conversational, narrative, instructional, and customer interaction scenarios. - Deliver natural, expressive speech with excellent control of tone, pacing, pronunciation, and clarity. - Maintain consistent voice quality, accent, and delivery throughout multiple recording sessions. - Follow Recording Standards - Adhere to detailed recording guidelines regarding recording environment, microphone setup, audio quality, and file formatting. - Produce multiple takes with different emotional styles, emphasis, or delivery when requested. - Ensure recordings are clean, free from background noise, and meet project quality standards. Qualifications - Native Southern American English speaker currently residing in the United States. - Authentic Southern U.S. accent (including regions such as Texas, Georgia, Tennessee, North Carolina, South Carolina, Louisiana, Alabama, Mississippi, or similar). - Professional experience in voice acting, narration, broadcasting, dubbing, podcasting, or related voice-based work. - Access to a professional or near-professional home recording setup, including: - High-quality microphone - Quiet recording environment - Pop filter or equivalent equipment - Strong vocal control with excellent diction, pronunciation, intonation, and emotional range. - Ability to accurately follow scripts while maintaining a natural and engaging delivery. - Availability to contribute 5–10 hours per week during the project period (approximately 1–2 weeks). Preferred Qualifications - Experience recording content for text-to-speech systems, AI speech datasets, audiobooks, IVR platforms, or voice assistants. - Familiarity with audio editing software such as Audacity, Adobe Audition, Reaper, or similar tools. - Ability to perform multiple vocal styles, including conversational, professional, energetic, calm, and instructional tones. Important Information - Voice recordings may be used to create a voice model for an internal customer experience (CX) AI application. - Applicants should only apply if they are comfortable with voice cloning for this specific internal use case. - Voice data will not be sold, licensed, or reused for unrelated commercial products or datasets. Why Join - Contribute to the development of next-generation AI speech technologies. - Apply your professional voice talent to innovative AI research. - Work remotely with a flexible schedule. - Participate in a high-impact project helping improve natural, human-like AI voice systems. Equal Opportunity Statement We are committed to providing equal opportunities to all qualified applicants without regard to legally protected characteristics. Reasonable accommodations are available upon request.
Role Description Join a cutting-edge AI research initiative focused on improving the quality, accuracy, and reasoning capabilities of next-generation artificial intelligence systems. We are seeking analytical professionals with exceptional critical thinking and communication skills to evaluate AI-generated responses across a variety of topics. In this role, you will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback that helps improve model performance. This opportunity is ideal for individuals who enjoy careful analysis, attention to detail, and working independently on intellectually challenging tasks. This is a fully remote, contract-based opportunity with flexible working hours. Key Responsibilities - Evaluate AI Responses - Review AI-generated content for accuracy, logical reasoning, completeness, and clarity. - Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions. - Assess responses using structured evaluation frameworks and detailed quality guidelines. - Provide High-Quality Feedback - Write clear, concise, and evidence-based rationales explaining evaluation decisions. - Highlight both strengths and areas for improvement in AI-generated outputs. - Apply consistent judgment across a wide range of evaluation tasks. - Maintain Evaluation Quality - Follow detailed project instructions and standardized assessment criteria. - Ensure evaluations are objective, accurate, and reproducible. - Complete assignments independently while maintaining high quality standards. Qualifications - Bachelor's degree from a globally recognized university (top-ranked institutions preferred). - Excellent analytical thinking and problem-solving abilities. - Strong written communication skills with the ability to explain complex reasoning clearly and precisely. - Exceptional critical reading skills, including the ability to identify: - Nuanced arguments - Implicit meaning - Logical inconsistencies - Missing context - Weak or unsupported reasoning - Strong attention to detail and ability to consistently apply structured evaluation guidelines. - Ability to work independently and manage assigned tasks efficiently. - Native-level English fluency. Preferred Qualifications - Experience in content evaluation, research, quality assurance, editing, or analytical review. - Familiarity with artificial intelligence, large language models, or AI evaluation methodologies. - Experience working with structured annotation or assessment frameworks. - Ability to produce thoughtful, objective, and well-supported written evaluations under defined quality standards. Engagement Details - Independent contractor engagement. - Fully remote with flexible working hours. - Work completed on your own schedule. - Project duration may be extended, shortened, or concluded based on business needs and performance. - Weekly payments processed through supported payment platforms. Why Join - Contribute to the development of next-generation AI technologies. - Help improve the reasoning, accuracy, and reliability of advanced AI systems. - Work on intellectually engaging projects with real-world impact. - Collaborate indirectly with leading AI researchers through high-quality evaluation work. Equal Opportunity Statement All qualified applicants will be considered without regard to legally protected characteristics. Reasonable accommodations are available upon request. Contract Information - Independent contractor engagement. - Fully remote work completed on your own schedule. - Weekly payments are processed based on approved work completed. - Work does not involve access to confidential or proprietary information from any employer, client, or institution. - Please note that visa sponsorship is not available for this opportunity.


