Careerflow.ai logo
Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Korean - Business Analyst P0 Evals

Business AnalystBusiness AnalystContractRemoteMid LevelTeam 11-50

Location

United Kingdom + 9 moreAll locations: United Kingdom | Canada | Germany | France | India | Brazil | Australia | Estonia | Japan | Portugal

Posted

17 hours ago

Salary

$16 / hour

Seniority

Mid Level

No structured requirement data.

Job Description

Korean - Business Analyst P0 Evals

Careerflow.ai

Role Description As a Business Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace (Corporate Gmail) account, you will evaluate how effectively the system leverages business email history to deliver relevant, personalized, and helpful responses. This role requires strong analytical thinking, attention to detail, and the ability to evaluate AI outputs objectively. - Evaluating AI-generated responses based on your professional email history and business account activity. - Assessing whether responses are relevant, accurate, helpful, and appropriately personalized. - Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations. - Comparing multiple AI responses and determining which provides the better overall user experience. - Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements. - Following project guidelines to ensure consistent, accurate, and high-quality evaluations. - Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process. Qualifications - Native-level proficiency in one of the following languages: German (DE), Japanese (JP), Korean (KO), French (FR). - Must currently reside outside the United States. - Must have an active Google Workspace (Corporate Gmail) account that is regularly used for professional communication. - Gmail display language must be set to the target project language. - The majority of emails in the inbox should be in the target language. - Must have a well-established business inbox with approximately 1,000+ emails and regular account activity. - Willing to use your primary business account for the evaluation and complete the required consent process. - Exceptional analytical thinking to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality. - Strong attention to detail to review AI-generated responses and identify subtle issues or inconsistencies. - Excellent written communication skills for providing clear and structured evaluation feedback. - Self-motivated and able to work independently in a remote environment. - Desktop or laptop with a reliable internet connection. Requirements - Bachelor's degree or equivalent practical experience in any field. - Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required. - Must be willing to use their primary personal account and sign the Required Consent form. Availability - Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST. Contract Duration - 16 weeks

Related Categories

Related Job Pages

More Business Analyst Jobs

Careerflow.ai logo

Japanese - Business Analyst P0 Evals

Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Business Analyst17 hours ago
ContractRemoteTeam 11-50

Role Description As a Business Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace (Corporate Gmail) account, you will evaluate how effectively the system leverages business email history to deliver relevant, personalized, and helpful responses. This role requires strong analytical thinking, attention to detail, and the ability to evaluate AI outputs objectively. - Evaluating AI-generated responses based on your professional email history and business account activity. - Assessing whether responses are relevant, accurate, helpful, and appropriately personalized. - Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations. - Comparing multiple AI responses and determining which provides the better overall user experience. - Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements. - Following project guidelines to ensure consistent, accurate, and high-quality evaluations. - Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process. Qualifications - Language Proficiency: Native-level proficiency in one of the following languages: German (DE), Japanese (JP), Korean (KO), French (FR). - Location: Must currently reside outside the United States. - Business Account: Must have an active Google Workspace (Corporate Gmail) account that is regularly used for professional communication. - Gmail Language: Gmail display language must be set to the target project language. - Inbox Language: The majority of emails in the inbox should be in the target language. - Email History: Must have a well-established business inbox with approximately 1,000+ emails and regular account activity. - Consent: Willing to use your primary business account for the evaluation and complete the required consent process. - Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality. - Attention to Detail: Strong ability to review AI-generated responses and identify subtle issues or inconsistencies. - Communication: Excellent written communication skills for providing clear and structured evaluation feedback. - Independence: Self-motivated and able to work independently in a remote environment. - Technical Setup: Desktop or laptop with a reliable internet connection. Requirements - Bachelor's degree or equivalent practical experience in any field. - Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required. - Must be willing to use their primary personal account and sign the Required Consent form. Availability - Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST. Location - Greenlit (except USA) Contract Duration - 16 weeks

United Kingdom + 9 moreAll locations: United Kingdom | Canada | Germany | France | India | Brazil | Australia | Estonia | Japan | Portugal
$18 / hour
Careerflow.ai logo

French - Business Analyst P0 Evals

Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Business Analyst17 hours ago
ContractRemoteTeam 11-50

Role Description As a Business Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace (Corporate Gmail) account, you will evaluate how effectively the system leverages business email history to deliver relevant, personalized, and helpful responses. This role requires strong analytical thinking, attention to detail, and the ability to evaluate AI outputs objectively. - Evaluating AI-generated responses based on your professional email history and business account activity. - Assessing whether responses are relevant, accurate, helpful, and appropriately personalized. - Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations. - Comparing multiple AI responses and determining which provides the better overall user experience. - Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements. - Following project guidelines to ensure consistent, accurate, and high-quality evaluations. - Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process. Qualifications - Native-level proficiency in one of the following languages: German (DE), Japanese (JP), Korean (KO), French (FR). - Must currently reside outside the United States. - Must have an active Google Workspace (Corporate Gmail) account that is regularly used for professional communication. - Gmail display language must be set to the target project language. - The majority of emails in the inbox should be in the target language. - Must have a well-established business inbox with approximately 1,000+ emails and regular account activity. - Willing to use your primary business account for the evaluation and complete the required consent process. - Exceptional analytical thinking to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality. - Strong attention to detail to review AI-generated responses and identify subtle issues or inconsistencies. - Excellent written communication skills for providing clear and structured evaluation feedback. - Self-motivated and able to work independently in a remote environment. - Desktop or laptop with a reliable internet connection. Requirements - Bachelor's degree or equivalent practical experience in any field. - Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required. - Must be willing to use their primary personal account and sign the Required Consent form. Availability - Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST. Contract Duration - 16 weeks

United States
$11 / hour
Careerflow.ai logo

Business Analyst

Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Business Analyst17 hours ago
ContractRemoteTeam 11-50

Role Description As a Personal Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses using your primary personal Gmail account (@gmail.com). You will evaluate how effectively the system leverages your email history to deliver relevant and personalized responses across English and your native language. This role requires strong analytical skills, attention to detail, and the ability to evaluate prompts and responses in English. - Evaluating AI-generated responses based on your personal email history and account activity. - Assessing whether responses are relevant, accurate, helpful, and appropriately personalized. - Reviewing prompts and AI responses in English while considering personalization across English and your native language. - Identifying incorrect personalization, unsupported assumptions, or irrelevant recommendations. - Comparing multiple AI responses to determine which provides the better overall user experience. - Providing clear, detailed, and objective evaluation feedback in accordance with project guidelines. - Maintaining data privacy and following all project confidentiality requirements throughout the evaluation process. Qualifications - Language Proficiency: Native speaker of one of the following languages: German (DE), Korean (KO). - Location: Must currently reside outside the United States. - Personal Account: Must have an active personal Gmail account (@gmail.com) that you use as your primary email account. - Mixed-Language Inbox: Your inbox must contain a meaningful mix of English and your target language, with each language representing at least 30% of your total inbox content. - Gmail Language: Gmail display language may be set to either English or your target language. - English Proficiency: Must be comfortable reading, understanding, and evaluating prompts and AI-generated responses in English. - Email History: Must have a well-established inbox with approximately 1,000+ emails and regular account activity. - Consent: Willing to use your primary personal Gmail account for the evaluation and complete the required consent process. - Exceptional Analytical Thinking: Ability to assess AI responses for relevance, personalization quality, and overall helpfulness. - Attention to Detail: Strong ability to identify subtle issues and inconsistencies in AI-generated responses. - Communication: Excellent written communication skills for providing clear and structured evaluation feedback. - Independence: Self-motivated and able to work independently in a remote environment. - Technical Setup: Desktop or laptop with a reliable internet connection. Requirements - Bachelor's degree or equivalent practical experience in any field. - Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required. - Must be willing to use their primary personal account and sign the Required Consent form. Availability - Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST. Location - Greenlit (except USA). Contract Duration - 16 weeks.

United States
$16 / hour
Careerflow.ai logo

Korean - Business Analyst P0 Evals-Personal Account

Careerflow.ai

Commitments Required: 40 hours per week with overlap of 6 hours with PST. Engagement type: Contractor (no medical/paid leave). Duration of contract: 6 months with opportunity to extend; expected start date is 1st week of Jun-2026. Location: North America and LATAM.

Business Analyst17 hours ago
ContractRemoteTeam 11-50

Role Description As a Personal Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses using your primary personal Gmail account (@gmail.com). You will evaluate how effectively the system leverages your email history to deliver relevant and personalized responses across English and your native language. This role requires strong analytical skills, attention to detail, and the ability to evaluate prompts and responses in English. - Evaluating AI-generated responses based on your personal email history and account activity. - Assessing whether responses are relevant, accurate, helpful, and appropriately personalized. - Reviewing prompts and AI responses in English while considering personalization across English and your native language. - Identifying incorrect personalization, unsupported assumptions, or irrelevant recommendations. - Comparing multiple AI responses to determine which provides the better overall user experience. - Providing clear, detailed, and objective evaluation feedback in accordance with project guidelines. - Maintaining data privacy and following all project confidentiality requirements throughout the evaluation process. Qualifications - Language Proficiency: Native speaker of one of the following languages: German (DE), Korean (KO). - Location: Must currently reside outside the United States. - Personal Account: Must have an active personal Gmail account (@gmail.com) that you use as your primary email account. - Mixed-Language Inbox: Your inbox must contain a meaningful mix of English and your target language, with each language representing at least 30% of your total inbox content. - Gmail Language: Gmail display language may be set to either English or your target language. - English Proficiency: Must be comfortable reading, understanding, and evaluating prompts and AI-generated responses in English. - Email History: Must have a well-established inbox with approximately 1,000+ emails and regular account activity. - Consent: Willing to use your primary personal Gmail account for the evaluation and complete the required consent process. - Exceptional Analytical Thinking: Ability to assess AI responses for relevance, personalization quality, and overall helpfulness. - Attention to Detail: Strong ability to identify subtle issues and inconsistencies in AI-generated responses. - Communication: Excellent written communication skills for providing clear and structured evaluation feedback. - Independence: Self-motivated and able to work independently in a remote environment. - Technical Setup: Desktop or laptop with a reliable internet connection. Requirements - Bachelor's degree or equivalent practical experience in any field. - Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required. - Must be willing to use their primary personal account and sign the Required Consent form. Availability - Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST. Location - Greenlit (except USA) Contract Duration - 16 weeks

United States
$16 / hour