Job Closed

This listing is no longer active.

Mercor logo
Mercor

Cincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.

Conversational AI Analyst

AnalystAnalystOtherRemoteMid LevelH1B No Sponsor

Location

United States + 1 moreAll locations: United States | Japan

Posted

94 days ago

Salary

$36 / hour

Seniority

Mid Level

Job Description

Conversational AI Analyst

Mercor

Role Description Evaluate LLM-generated responses on their ability to effectively answer user queries. - Conduct fact-checking using trusted public sources and external tools. - Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies. - Assess reasoning quality, clarity, tone, and completeness of responses. - Ensure model responses align with expected conversational behavior and system guidelines. - Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines. Qualifications - Must-Have - Bachelor’s degree - Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Japanese - Significant experience using large language models (LLMs) - Excellent writing skills - Strong attention to detail - Adaptable and comfortable moving across topics, domains, and customer requirements - Background or experience in domains requiring structured analytical thinking - Excellent college-level mathematics skills - Preferred - Prior experience with RLHF, model evaluation, or data annotation work - Experience writing or editing high-quality written content - Experience comparing multiple outputs and making fine-grained qualitative judgments - Familiarity with evaluation rubrics, benchmarks, or quality scoring systems Company Description Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Job Requirements

  • Must-Have
  • Bachelor’s degree
  • Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Japanese
  • Significant experience using large language models (LLMs)
  • Excellent writing skills
  • Strong attention to detail
  • Adaptable and comfortable moving across topics, domains, and customer requirements
  • Background or experience in domains requiring structured analytical thinking
  • Excellent college-level mathematics skills
  • Preferred
  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments
  • Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

Related Categories

Related Job Pages

More Analyst Jobs

Aqua Finance, Inc. logo

Funding Analyst

Aqua Finance, Inc.

Aqua provides flexible financing programs to dealers, contractors, and retailers so families can realize their dreams.

Analyst94 days ago
OtherRemoteTeam 201-500Since 1985H1B No Sponsor

• Auditing documents across diversified programs • Onboarding a compliant document package for funding release • Taking incoming and making outgoing calls from dealers • Using origination software to track, note, and log document lifecycle prior to onboarding • Reviewing loan documents for errors/omissions based on an audit checklist provided by management • Determining if app file is ready for onboarding by validating all document requirements and stipulations have been met • Controlling the flow of documents through the lifecycle of the loan using workflow management software • Providing positive dealer experience through email and phone correspondence • Organizing daily workload to ensure completion of tasks by appropriate deadlines • Collaborating cross-departmentally, answering questions, and ensuring process flow efficiencies • Assigned imaging duties • Daily/weekly funding reports

United States
Job Closed
Crumdale Specialty logo

Eligibility & Configuration Analyst

Crumdale Specialty

Innovative Insurance Solutions. Better Benefits.

Analyst94 days ago
OtherRemoteTeam 51-200Since 2014H1B No Sponsor

**Key Responsibilities** **1. Systems & Vendor Integration** - Act as the primary operational contact for eligibility and enrollment vendors - Monitor daily inbound/outbound eligibility files, validating formats, tracking, and acknowledgments - Troubleshoot file errors in partnership with the claims system team, external vendors, and internal stakeholders - Manage file connections across BenAdmin platforms, PBM, networks, CMS, and other partners **2. Eligibility Operations & Data Quality** - Maintain, update, and audit eligibility data across systems (including VBA) - Perform discrepancy research and root‑cause analysis across PBM, network, and claims data feeds - Process manual enrollments, terminations, and demographic changes as needed - Ensure timely and accurate eligibility for ID card production, claims adjudication, billing, and reporting **3. Claims System Configuration** - Build and configure new employer groups within the claims system (VBA) - Configure benefits, billing rules, workflows, and plan structures to support downstream teams - Maintain configuration integrity to ensure claims, billing, reporting, and member support function without system barriers **4. ID Card Configuration** - Configure ID card rules within claims and vendor systems - Create and maintain digital ID card templates and PDFs - Execute quick‑turn card updates driven by eligibility or plan changes **5. Implementation Support** - Support new client implementations by preparing EDI, configuration, connectivity, and operational readiness - Track milestones and dependencies across PBM, networks, vendors, ID cards, billing, and portals - Collaborate with internal teams and external partners to ensure a smooth and timely go‑live **6. Operational Excellence** - Maintain SOPs for eligibility workflows, reconciliations, and file exception handling - Ensure data integrity and operational efficiency as membership and vendor volume scales - Partner cross‑functionally with Billing, Claims, Customer Care, Networks, and IT teams

Pennsylvania
Job Closed
OtherRemoteTeam 5,001-10,000

The SouthState story is one of steady growth, deep community roots, and an unwavering commitment to helping our customers move forward. Since our beginnings in the 1930s to becoming a trusted financial partner across the South and beyond - we are known for combining personal relationships with forward-thinking solutions. We are committed to helping our team members find their success while maintaining the integrity of our values: building trust, fostering lasting relationships and pursuing excellence. At SouthState, individual contributions are recognized, potential is cultivated and team members are inspired to achieve their greater purpose. Your future begins here! SUMMARY/OBJECTIVES This position is responsible for, but not limited to, serving the Credit Administration staff and Relationship Managers by providing analytical and loan decision support through the preparation of financial statement spreads for commercial loan borrowers, guarantors, and related entities. Additional tasks may be required at the direction of the Director of Commercial Credit Analysts and/or the Director of Credit Services. ESSENTIAL FUNCTIONS This position is expected to perform the specific duties, tasks, and responsibilities as outlined below: - Performs spreads and credit analysis of commercial borrowers and guarantors, utilizing audited, reviewed, and complied financial statements and tax returns. - Performs personal cash flow analysis utilizing individual tax returns and personal financial statements. - Performs complex spread requests for specialized lending groups: (i.e. middle market loans, franchise finance, not-for-profits, municipalities, homebuilder loans, religious organizations, associations, foreign financials, trusts, bank vendors, and enterprise value loans). - Uses independent judgement and discretion to appropriately provide detailed Credit Analysis on all spread requests. - Due to the complexity and significance of the Bank’s loan portfolio, careful judgement and discretion is required to properly assess the risk to the Bank’s mission and goals. - Demonstrates the ability to work independently with minimal oversight - Participates and leads various training and mentoring sessions with other Credit Analysts and Commercial Associates. - Communicates with Relationship Managers, Portfolio Managers, and Credit Administrators as needed to convey concerns and/or risks related to loans. - Utilizes credit-reporting services to compile reports relating to the credit history of current and potential customers. - Ensures that all work prepared is timely and turned around within department guidelines and with the utmost accuracy. - Researches and analyzes financial data, interprets, and prepares reports of financial position and determines if additional information is needed to properly analyze the financial condition of a borrower so that a proper decision is made regarding approval or declination of credit. - Monitors the financial position of established accounts and brings irregularities to the attention of the loan officer. - Works with Portfolio Managers to learn the Portfolio Manager role and to assist with underwriting/servicing tasks as needed. - Successfully works with teammates to collectively assist the Commercial Credit Analyst team in stated objectives and tasks. - Works to create a constructive workplace environment that expands positive culture and enhances the Bank’s core values. - Undertakes special projects that may be deemed of significant importance to the Chief Credit Officer. - Participates in community related activities. - Ensures that the Bank’s policies and procedures, code of conduct, and regulatory guidelines are strictly complied with. - Provides aid to other employees by liaising with them through healthy and positive interactions. - Continuously updates skills by participating in professional training and development. - Seeks opportunities to improve skills through cross-training offered by the Bank. - Position may require regular before/after normal business hours, or regular out-of-town travel - All other tasks, responsibilities, or duties, as directed by the Commercial Credit Analyst Team Lead or the Director of Commercial Credit Analysts. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Qualifications, Education, and Certification Requirements - A bachelor’s degree in business, finance, or accounting is recommended to have a good understanding of financial statements and to make industry evaluations. Finance/accounting related work experience of at least five years in lieu of a college degree in business, finance, and accounting. - Work as a Commercial Credit Analyst, or similar credit position, for a minimum of one year. - Knowledge of personal computer, Windows and Microsoft software applications is necessary. TRAINING REQUIREMENTS/CLASSES - New Employee Orientation - Required Annual Compliance Training - Successful completion (in a reasonable timeframe) of an initial training and review period at the start of the role, at which time the essential functions will be required. - Various trainings provided by corporate training, credit staff to enhance knowledge of credit process - Additional trainings as directed by the Director of Commercial Credit Analysts PHYSICAL DEMANDS - Must be able to remain seated or work standing in a confined area on a computer for a minimum of four (4) hours each workday - Must be able to constantly use hands and fingers to enter data through or on a computer or answer a phone throughout most of an eight (8) hour shift - Must be able to hear and communicate with coworkers and customers throughout the day - May need to lift to 25 pounds one to two times a day to perform job - Position may require regular before/after normal business hours, or regular out-of-town travel. WORK ENVIRONMENT - Must be able to function in a professional, business office environment and act and dress appropriately for same, consistent with the Bank’s grooming and dress codes - Must demonstrate excellent interpersonal skills with customers and coworkers - Must be willing to function as a team member - Must be willing to demonstrate commitment to the Bank’s mission and goals Equal Opportunity Employer, including disabled/veterans.

United States
Job Closed
Full TimeRemoteTeam 1,001-5,000Since 30+ yearsH1B Sponsor

• Analyze and interpret complex healthcare data • Collaborate with cross-functional teams, providing analytical insight to inform strategy and interventions • Generate comprehensive reports, graphics, and dashboards that effectively summarize and display data for key stakeholders • Review reports and data for pattern identification and trend analysis, providing management level summaries • Provide technical expertise and guidance to team members on SQL, SAS, and DAX coding best practices • Interpret and maintain understanding of technical specifications and quality reporting requirements • Interact and work collaboratively with business partners on analytics requests and identifying trends • Collaborate with IT teams to enhance data collection and reporting systems • Perform any other job duties as assigned

United States
$72.2K - $115.5K / year
Job Closed