Revolutionize the way individuals perceive, access, and engage with mental health care
AI Product Analyst
Location
CET (UTC+1)
Posted
9 days ago
Salary
0
Seniority
Mid Level
No structured requirement data.
Job Description
AI Product Analyst
MEDvidi
Role Description We are hiring a Product Analyst to help us evaluate, monitor, and improve AI agents and LLM-powered workflows operating at scale. This role is focused on analyzing real AI system behavior in production environments: - Understanding product and operational impact - Identifying failure patterns on generational tasks - Measuring quality and reliability of outputs - Helping teams make accurate decisions under ambiguity Qualifications - 3+ years of experience in analytical roles related to AI systems, ML products, automation platforms, or complex production systems - Strong Python skills for deep analytical investigations and working with large-scale noisy text data - Advanced SQL skills - Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, model trade-offs, and AI failure modes - Experience building monitoring systems, analytical frameworks, or operational dashboards for production systems - Ability to work with incomplete, ambiguous, and rapidly changing data environments - Strong ownership mindset and ability to independently drive investigations and analytical conclusions - Ability to connect AI system quality with business and operational impact - Fluent Russian; English level B2 or higher - Ability to work CET-overlapping hours Requirements - Experience with conversational AI or AI agents - Experience evaluating LLM outputs or annotation quality - Experience with AI quality metrics and evaluation methodologies - Experience working with Langchain infrastructure - Experience with ML data pipelines or synthetic data generation - Background in anomaly detection Responsibilities - Analyze production behavior of AI agents, automation systems, and LLM-powered workflows - Investigate hallucinations, inconsistencies, failure modes, and quality degradation across automated user journeys - Work directly with logs, conversations, raw system outputs, and operational datasets to identify hidden patterns and actionable insights - Design evaluation approaches and analytical frameworks for measuring AI system quality and reliability - Build monitoring systems and dashboards for AI performance visibility - Identify operational and product risks introduced by automation - Measure the impact of AI systems on business metrics, operational efficiency, and user experience - Detect data quality issues, shifts, and anomalies affecting AI system performance - Partner closely with Product, Engineering, QA, and Operations teams on AI-related initiatives - Support rapid decision-making in fast-changing and ambiguous environments Benefits - Health insurance after probation period - Sports & wellness compensation - Fully remote, long-term B2B collaboration - 19 working days of vacation per year - 3 additional wellness days per year - Paid sick leave for the first 5 working days - Gifts to employees for important events - Personalized English lessons via Preply
Related Guides
Related Categories
Related Job Pages
More Product Analyst Jobs
Senior Actuarial Analyst
UnitedHealth GroupUnitedHealth Group is a healthcare and well-being company that’s dedicated to improving the health outcomes of millions around the world. We are comprised of two distinct and com
Title: Senior Actuarial Analyst - Remote Location: Eden Prairie United States Job Description: Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. We are seeking a Senior Actuarial Analyst to join our team. This role is designed for actuaries with foundational experience who are ready to take on more complex analytical work, increased ownership, and broader influence across projects. The Senior Actuarial Analyst will independently manage analyses, develop non-standard models and reporting, and provide insights that support forecasting, trend analysis, and business decision-making. This role builds on entry-level actuarial experience and accelerates development toward advanced technical and strategic contributions. You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week. Primary Responsibilities: - Advanced Data & Analytical Work - Perform complex and non-standard data extraction, validation, and analysis using SQL, SAS, Excel, or similar tools - Develop, enhance, and maintain actuarial models and analytical frameworks - Independently investigate trends, variances, and emerging issues and perform additional analyses as needed - Identify and resolve data and modeling issues proactively, often before review - Reporting & Insights - Produce both standard and non-standard reporting with accuracy and clear interpretation of results - Translate complex analyses into meaningful business insights for stakeholders\ - Support forecasting, reserving, and trend analytics with increasing ownership of assumptions and outputs - Draw conclusions from results and highlight key drivers and implications for the business - Communication & Influence - Communicate findings, interpretations, and recommendations to managers, directors, and cross-functional stakeholders - Actively participate in and occasionally lead team discussions - Explain analytical results clearly, focusing on the 'so what' for business impact - Serve as a resource and mentor to junior analysts (e.g., SG26) - Project & Task Management - Manage multiple projects simultaneously with minimal supervision - Independently prioritize work, deadlines, and competing demands - Take ownership of deliverables, including timelines, quality, and stakeholder communication - Volunteer for and contribute to initiatives outside immediate scope to support team objectives You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in. Required Qualifications: - Bachelor's degree in Actuarial Science, Mathematics, Statistics, Economics, or related field - 2+ years of actuarial or relevant analytical experience - Progress toward actuarial credentials (typically 2-3+ exams passed; 3-4+ preferred) - Commitment to continued exam progression within the Actuarial Education Program - Advanced Excel skills (model building, complex formulas, efficient reporting) - Intermediate SQL and/or VBA (ability to write new code and build processes) - Demonstrated solid performance in prior actuarial role(s) - Demonstrated ability to build and automate data extraction and reporting workflows Preferred Qualification: - Experience with Power BI, PowerPivot, SAS, or similar tools - All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $72,800 to $130,000 annually based on full-time employment. We comply with all minimum wage laws as applicable. Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants. At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. UnitedHealth Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.
Product Data Analyst
Associated PressHeadquartered in New York, New York, the Associated Press is an award-winning, not-for-profit cooperative of global news organizations. Founded in 1946, the Associated Press is now
Title: Product Data Analyst Location: New York, NY, US, 10281 Workplace: Regular Department: (2) Professionals Job Description: The Associated Press is an independent global news organization dedicated to factual reporting. Founded in 1846, AP today remains the most trusted source of fast, accurate, unbiased news in all formats and the essential provider of the technology and services vital to the news business. More than half the world's population sees AP journalism every day. The Associated Press seeks a Product Analyst for AP News based in New York City. We are a hybrid environment on site three days a week. About the Role As a Product Analyst, you will help shape how AP News uses data to improve its digital products and user experience. You will analyze how users discover, navigate and engage across web and app experiences, and turn those findings into clear, actionable recommendations that inform product strategy, experimentation and long-term growth. This role is well suited for someone who combines strong technical analytics skills with product instinct and can communicate effectively with both technical and non-technical stakeholders. What You'll Do: Generate Product and User Insights - Design and build repeatable analyses and dashboards using BigQuery, Looker Enterprise and Hex to surface patterns in user behavior, feature adoption, engagement and conversion across APNews.com and the AP app - Analyze user journeys, funnels and retention trends to identify opportunities to improve engagement, loyalty and product performance - Support tracking implementation in Google Analytics 4 and Google Tag Manager to ensure the right data is captured to answer critical product and business questions Translate Data Into Strategic Recommendations - Translate complex product and user data into clear recommendations that inform product roadmaps, business priorities and monetization decisions - Identify strategic opportunities in user journeys, feature design and engagement funnels to deepen loyalty and improve user experience - Evaluate product experiments and A/B tests to measure impact on engagement, retention and revenue-related metrics - Distill findings into actionable plans and partner with product managers, editors and engineers to turn analysis into measurable outcomes Partner Across the Organization - Build trusted relationships across product, editorial and technical teams to understand business questions and translate them into analytical work - Collaborate with data engineering and product development teams to ensure data infrastructure and instrumentation support decision-making - Communicate findings clearly and persuasively to stakeholders with different levels of technical fluency, from cross-functional partners to senior leadership Who You Are: - 3+ years of professional experience in digital product analytics, growth analytics, user analytics or a related analytical role - Bachelor's Degree in a relevant field (Communications, Journalism, Statistics, Data Science, Marketing) or equivalent experience in product analytics - Strong command of SQL and working knowledge of Python or R for querying large datasets, identifying trends and building repeatable analyses - Hands-on experience with analytics and visualization tools such as BigQuery, Hex and Looker Enterprise - Experience with Google Analytics 4 and Google Tag Manager, including event tracking and measurement strategy - Demonstrated ability to analyze user behavior, product performance and engagement trends and turn those findings into actionable business recommendations - Experience working with product managers, engineers and non-technical stakeholders in a cross-functional environment - Strong communication skills, including the ability to explain technical findings clearly, distill insights into action and influence decisions with varied audiences - Curiosity, sound judgment and comfort working through open-ended questions with a practical, collaborative approach What will set you apart: - Experience in digital publishing, media or content-driven products - Background working with BigQuery or other large-scale data warehousing platforms - Familiarity with content recommendation systems or personalization strategies - Experience with experimental design and A/B testing platforms Location: AP News based in New York City. We are a hybrid environment on site three days a week. Why join us: - A mission-driven, inclusive environment focused on both individual and collective success. - Opportunities for professional development to help you reach your career goals. - Access to tools, mentorship, and resources tailored to elevate your proficiency and contributions. The anticipated salary range for this position is $103,000 – 128,000 , based on a candidate’s skills, qualifications and location. The Associated Press offers comprehensive benefits, which include: - Competitive medical, dental and vision coverage - Retirement benefits - Company paid life insurance - Paid vacation and sick days - Paid parental leave for any new parent - Mental well-being resources AP seeks to build an inclusive organization grounded in respect for differences. We support all aspects of diversity and provide equal employment opportunities to all employees and applicants without regard to race, color, religion, sex, marital status, national origin, age, sexual orientation, gender identity, disability, status as a veteran, or other characteristic protected by law.
Actuarial Analyst
The Hanover Insurance GroupFor more than 170 years, The Hanover has been committed to delivering on our promises and being there when it matters the most. We live our values every day, demonstrating we CARE through our values, Sustainability initiatives and inclusive corporate culture.
Role Description This role within the Corporate Actuarial department will be responsible for helping to ensure the strength of Hanover’s balance sheet and providing management with critical insights through the Reserving analysis process. Various forms of analysis include: - A formal quarterly review of the loss and DCCE reserves by accident and/or report year - Appropriate business unit segmentation of carried reserves - An annual ULAE reserve review - A forecast of the ex-cat loss and ALAE ratios for the corporate financial plan - Various “deep dives” An effective candidate will also be able to suggest ways to improve our current processes by identifying enhancements and efficiencies. Effective communication skills are critical, as a high level of collaboration with the Business (Underwriting & Pricing), Claims, Accounting, and Finance is expected. Additionally, this role provides a high degree of exposure to executive leaders. The person who takes on this role would also be an active member of the Actuarial and Analytics community. This is a Full-time, Exempt role. Qualifications - Bachelor’s Degree or equivalent - One or more Casualty Actuarial Exams - Programming skills, including the ability to debug and automate processes (SQL, VBA) - Experience using Microsoft Office, including Excel and PowerPoint - Understands fundamental analytical concepts, practices, and procedures Requirements - Ability to multitask and meet all deadlines with quality analysis - Thoroughness - Demonstrates careful attention to detail. Keeps tasks and responsibilities clearly defined, on schedule, and error-free. Carries tasks, assignments, etc., through to completion - Analytical Thinking - Applies analytical techniques to resolve problems or issues - Teamwork - Fosters an environment where individuals collaborate in pursuit of a common goal - Communication for Results - Ability to express technical and business concepts clearly - Growth Mindset - Embraces a creative approach and a changing environment - Results Orientation - Excited by challenging goals and a desire to exceed standards of excellence Benefits - Medical, dental, vision, life, and disability insurance - 401K with a company match - Tuition reimbursement - PTO - Company paid holidays - Flexible work arrangements - Cultural Awareness Day in support of IDE - On-site medical/wellness center (Worcester only)
Product Test Analyst
BeyonkBeyonk Group is on a mission to help experience and attraction businesses grow faster and smarter. As a full-scale growth partner, we combine industry-leading booking and ticketing software with powerful marketing services and data-driven insights - helping attractions and experience providers operate efficiently, reach more visitors, and maximise revenue. We’re growing fast, welcoming thousands of customers a day to incredible experiences, and expanding across the UK and US. We work partly remotely and partly from our London office, in a fast-paced, collaborative, and ambitious environment. Join us at the early stages of an exciting new chapter for Beyonk Group. We’re a lean team where every role matters and every voice counts. Beyonk Group is an equal opportunity employer.
Role Description Beyonk Group is hiring a Product Test Analyst to join our small Product team, reporting to our lead QA Engineer and working across both of our ticketing platforms - Beyonk and BookingHound. - Develop deep subject matter expertise across Beyonk and BookingHound, including the provider dashboards, customer-facing booking flows, POS, and partner integrations. - Hold a very high bar on quality, stability, and usability across both products. - Own sign-off on feature & fixes before they are released to production. - Run thorough manual and exploratory testing on new features and fixes. - Validate work against acceptance criteria and challenge gaps in requirements. - Reproduce, isolate, and clearly document bugs reported internally and by customers. - Test newer extensions of the products including our MCP work and other tools. - Build a robust manual regression test suite. - Identify key areas of the products where we could benefit from building automation tests. - Support incident response when issues reach production, helping diagnose, contain, and learn from them. - Act as the first point of contact for technical issues escalated from Customer Success. - Work with Customer Success & Product teams to assess urgency, impact, and priority of customer-reported issues. - Reproduce issues, gather evidence, and raise high-quality Linear tickets. - Help Customer Success troubleshoot product knowledge questions. - Feed recurring issues back into product, documentation, and QA processes. - Work with lead QA Engineer to identify recurring issues and propose process or tooling changes. - Understand product development lifecycle and how you impact each stage. - Pair with Engineering and Product team early in the delivery process. - Provide structured feedback on tickets, designs, and technical approaches. Qualifications - 1-3 years of QA experience in a software product environment, ideally B2B SaaS. - Experience as a QA Technician/Tester, Product Test Analyst, or transferable skills from another role (e.g., Customer Success). - Strong manual and exploratory testing skills. - A keen eye for detail and the patience to dig into harder-to-reproduce issues. - Genuine curiosity about how products work end to end. - Solid working knowledge of browsers and browser technologies. - Comfortable working alongside Customer Success and communicating clearly with non-technical colleagues. - Clear, precise written communication, particularly when documenting bugs and test cases. - Strong commercial judgement. - Comfortable in a small, fast-paced team. Requirements - Some of the tools and apps we use regularly are: Linear, Slack, Sentry, Figma, Browserstack, Chrome DevTools, Claude, Stripe, and more. Benefits - Real responsibility from the start - You will be trusted to hold the quality bar on software that real customers depend on. - Exposure across the business - You will work closely with Engineering, Product, and Customer Success. - Opportunities to learn and progress - Opportunities to grow into broader QA, automation, or adjacent roles. - A team that takes ownership - A small, driven team that cares about doing things properly. - A culture of contribution - You will help improve processes.

