Role Description We are sharing a specialised full-time consulting opportunity for US-based insurance professionals with deep experience in underwriting, claims, actuarial analysis, risk management, and structured evaluation of AI-generated outputs. This role supports a high-impact generative AI initiative focused on improving how advanced models reason through real-world insurance scenarios. Selected professionals will design rigorous domain-specific tasks, evaluate model outputs against structured criteria, develop scoring frameworks, and provide practical feedback grounded in senior-level underwriting, claims, and risk-assessment experience. Key Responsibilities - Insurance Domain Guidance - Guide research and engineering teams on underwriting, claims, actuarial analysis, policy interpretation, and risk-assessment concepts. - Identify gaps in model understanding across coverage decisions, loss evaluation, pricing, claims handling, and insurance operations. - Apply practical insurance judgment to complex scenarios involving policyholders, exposures, financial risk, and regulatory considerations. - Ensure insurance tasks reflect realistic professional decisions and industry standards. - Insurance Task & Solution Development - Design challenging, domain-relevant tasks grounded in real underwriting, claims, actuarial, or risk-management practice. - Write accurate, well-reasoned solutions covering insurance analysis and decision-making scenarios. - Develop problems requiring technical judgment, risk evaluation, policy interpretation, and assessment of competing considerations. - Ensure tasks are clear, internally consistent, and suitable for structured evaluation. - AI Output Evaluation - Evaluate AI-generated insurance responses against established rubrics and scoring criteria. - Assess correctness, professional judgment, reasoning quality, relevance, and practical applicability. - Compare alternative outputs and determine which response provides the stronger insurance analysis. - Identify factual errors, unsupported assumptions, weak risk reasoning, and incomplete conclusions. - Provide clear written feedback that supports improvements in model behaviour. - Rubric Development & Quality Calibration - Develop and refine evaluation guidelines for underwriting, claims, actuarial, and risk-management tasks. - Define scoring criteria covering technical accuracy, professional judgment, reasoning, and decision quality. - Participate in calibration activities with other insurance specialists. - Collaborate across teams to maintain consistency and accuracy throughout the training data. Qualifications - At least 8 years of dedicated professional experience in insurance. - Senior-level expertise in underwriting, claims, actuarial work, risk management, or a related area. - Experience working within a recognised insurer, broker, consultancy, financial-services organisation, or comparable institution. - Prior hands-on experience evaluating LLM or AI-generated outputs using structured rubrics or scoring criteria. - Demonstrable career progression into senior, management, director, vice president, or comparable leadership responsibilities. - Strong professional judgment and the ability to assess complex insurance decisions. - Excellent written and verbal communication skills. - Reliable availability for at least 35 hours per week during weekdays. Educational Background - A degree in insurance, actuarial science, finance, economics, mathematics, business administration, risk management, or a related field is highly relevant. - Graduate-level education in actuarial science, finance, business, analytics, or risk may be helpful. - Equivalent senior professional experience in underwriting, claims, or insurance operations may also be considered. - Professional credentials such as CPCU, ACAS, FCAS, ARM, AIC, or comparable qualifications may be valuable. Nice to Have - Experience across property and casualty, life, health, commercial, specialty, or reinsurance markets. - Background in complex underwriting, claims investigation, pricing, reserving, or portfolio risk. - Experience creating structured scoring rubrics, evaluation guidelines, or quality frameworks. - Familiarity with model training, human-feedback workflows, annotation, or AI quality assurance. - Strong understanding of policy language, coverage interpretation, risk selection, and claims decision-making. - Experience reviewing underwriting files, claims assessments, actuarial analyses, or risk reports. - Previous collaboration with product, analytics, legal, compliance, research, or technical teams. Why This Opportunity - Apply senior insurance expertise to an advanced generative AI initiative. - Influence how AI systems reason about underwriting, claims, and risk. - Design and assess challenging insurance problems grounded in practical industry experience. - Collaborate with technical teams and experienced insurance specialists. - Join a full-time remote engagement with competitive hourly compensation. Contract Details - Full-time W-2 contingent employment arrangement. - Fully remote role available to candidates based in the United States. - Expected commitment of at least 35 hours per week during weekdays. - Competitive rates between $55–$75 per hour depending on expertise and project scope. - Prior experience evaluating AI or LLM outputs against structured rubrics is required. - Applicants should clearly describe relevant AI evaluation experience in their application. - Immediate availability is preferred. - Work may include onboarding, specialty calibration, task development, and ongoing quality review. - Project scope and duration may be adjusted according to programme requirements and performance. About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy .