Overview Are you passionate about linguistics, language quality, and evaluation? We are launching an exciting language evaluation project and are looking for German-speaking linguistics experts to join our team as Quality Control Specialists. In this role, you will assess and refine AI-generated language outputs, focusing on linguistic accuracy, grammar, and cultural relevance. Your expertise will play a critical role in improving conversational AI systems. What you will do: - Review and evaluate AI-generated text for linguistic accuracy, grammatical correctness, and cultural appropriateness. - Identify issues and provide high-quality rewritten responses to improve language outputs. - Develop natural prompts and responses in the target language to enhance conversational datasets. - Collaborate with global teams to improve the quality and performance of AI language models. Project Details: - Start Date: ASAP - Duration: 4 weeks - Commitment: ~20 hours/week (flexible schedule) - Job Type: Freelance contract - Pay Rate: $35 - Location: Germany, Austria (Remote) Requirements: - Strong academic or professional background in linguistics (required). - Native or professional proficiency in German with excellent written communication skills. - Deep understanding of grammar, linguistic structures, and cultural nuances of the target language. - Experience in language review, evaluation, or similar roles. - Comfortable working with structured tasks such as preference ranking, prompt-response writing, grammaticality checks, and text improvement. - Detail-oriented with the ability to deliver clear, constructive feedback. This is a unique opportunity to apply your linguistics expertise to cutting-edge AI projects. Join our team and help shape the future of AI communication! Why Join Welo Data? ✨ Limitless Flexibility  Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.  🌱 Limitless Growth  Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.  🌍 Limitless Support  Be part of a global contributor community with responsive guidance and support.  💡 Real Impact  Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills. How to Apply? Apply now by answering a few quick questions to join our database and become part of our growing community. About Welo Data Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.

Overview Are you passionate about linguistics, language quality, and evaluation? We are launching an exciting language evaluation project and are looking for Bengali-speaking linguistics experts to join our team as Quality Control Specialists. In this role, you will assess and refine AI-generated language outputs, focusing on linguistic accuracy, grammar, and cultural relevance. Your expertise will play a critical role in improving conversational AI systems. What you will do: - Review and evaluate AI-generated text for linguistic accuracy, grammatical correctness, and cultural appropriateness. - Identify issues and provide high-quality rewritten responses to improve language outputs. - Develop natural prompts and responses in the target language to enhance conversational datasets. - Collaborate with global teams to improve the quality and performance of AI language models. Project Details: - Start Date: ASAP - Duration: 4 weeks - Commitment: ~20 hours/week (flexible schedule) - Job Type: Freelance contract - Pay Rate: $25 USD/hour - Location: Bangladesh, India (Remote) Requirements: - Strong academic or professional background in linguistics (required). - Native or professional proficiency in Bengali with excellent written communication skills. - Deep understanding of grammar, linguistic structures, and cultural nuances of the target language. - Experience in language review, evaluation, or similar roles. - Comfortable working with structured tasks such as preference ranking, prompt-response writing, grammaticality checks, and text improvement. - Detail-oriented with the ability to deliver clear, constructive feedback. This is a unique opportunity to apply your linguistics expertise to cutting-edge AI projects. Join our team and help shape the future of AI communication! Why Join Welo Data? ✨ Limitless Flexibility  Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.  🌱 Limitless Growth  Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.  🌍 Limitless Support  Be part of a global contributor community with responsive guidance and support.  💡 Real Impact  Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills. How to Apply? Apply now by answering a few quick questions to join our database and become part of our growing community. About Welo Data Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.

• Define the testing standards and patterns for AI at Roofr — establishing how product teams validate AI behaviour when building on top of the application foundation • Build and own Roofr's LLM eval framework — selecting and extending the right tooling (e.g. Promptfoo, DeepEval, Braintrust) and designing the methodology that measures whether our AI integrations and agent outputs are performing correctly, consistently, and safely • Integrate quality gates into CI/CD pipelines so that regressions in AI behaviour are caught before they reach production • Design and implement human-in-the-loop review processes for AI outputs where automated evaluation isn't sufficient • Embedded on the AI Platform team — ensuring quality is designed into the integration architecture from day one, not bolted on after the fact • Work horizontally across the testing organization — coaching QA engineers and developers on AI eval patterns, embedding best practices into team workflows, and actively raising the quality bar across engineering • Stay close to the evolving AI quality landscape — new eval techniques, benchmarking approaches, and tooling like Ragas, Arize Phoenix, or LangSmith — and bring the best of it to Roofr

• Lead quality activities across all phases of development • Establish and implement quality management across greenfield and brownfield projects • Support projects from proposal through closeout using structured problem-solving • Lead quality oversight of project partners • Establish, implement, and continuously improve the Quality Management System (QMS) • Lead performance-based audits and corrective action programs • Monitor regulatory developments and industry standards • Ensure quality requirements are defined and flowed down across project activities • Oversee QA requirements for software and digital tools affecting licensing or quality • Establish and implement the vendor qualification program • Define, track, and report quality performance metrics • Build and lead the quality organization • Support implementation of digital tools and process improvements