Role Description We're hiring an AI Product Analyst to help us evaluate, monitor, and improve Voice AI systems operating at scale. You'll work at the intersection of Product, Engineering, Operations, and AI, helping the team understand how AI behaves in the real world, where it creates value, where it fails, and what should be improved next. Why this role: - Work on one of the most visible AI products inside MEDvidi. - Help shape the future of Voice AI in healthcare. - Influence product decisions using real production evidence. - High ownership in a fast-moving, product-driven medical tech company. Responsibilities: - Analyze production behavior of Voice AI Agents and conversational AI workflows. - Investigate hallucinations, inconsistencies, silent failures, and quality degradation in AI-driven conversations. - Work directly with call transcripts, logs, generated outputs, and operational datasets to uncover patterns and actionable insights. - Design evaluation frameworks for measuring AI quality, reliability, and business impact. - Build monitoring systems and dashboards for AI performance visibility. - Measure the impact of AI systems on operational efficiency, business outcomes, and patient experience. - Detect quality shifts, anomalies, and emerging failure modes in production environments. - Partner closely with Product, Engineering, QA, and Operations teams on AI initiatives. - Support rapid decision-making in fast-changing and ambiguous environments. This role is not for you if: - You prefer working only with structured datasets and predefined metrics. - You are uncomfortable analyzing raw conversations, transcripts, and AI-generated outputs. - You expect clearly defined answers rather than investigating ambiguous problems. - You are not interested in understanding how AI systems fail in production. Qualifications - 3+ years of experience in Product Analytics, Data Analytics, Operational Analytics, or analytics roles within complex production systems. - Strong SQL skills. - Python for analytical investigations and working with large-scale text datasets. - Understanding of LLM limitations, hallucinations, evaluation challenges, prompt sensitivity, and AI failure modes. - Experience building monitoring systems, analytical frameworks, or operational dashboards. - Strong communication skills and ability to translate analysis into product decisions. - Ability to work effectively in ambiguous and fast-changing environments. - Fluent Russian; English level B2 or higher. - Ability to work CET-overlapping hours. Requirements - Experience with conversational AI or AI agents. - Experience evaluating LLM outputs. - Experience with AI quality metrics and evaluation methodologies. - Experience with prompt iteration and AI evaluation frameworks. - Experience working with ML pipelines or AI-powered products. Benefits - High-impact environment: A chance to influence how AI is used in real patient interactions. - Growth & compensation: Competitive compensation and clear growth opportunities. - Remote-first: Fully remote, long-term B2B collaboration. - Health & wellness: Health insurance after the probation period, plus sports & wellness compensation. - Career development: Career growth, including personalized English lessons via Preply. - Time off: 19 working days of vacation per year, 3 additional wellness days, and paid sick leave for the first 5 working days. - Culture: Thoughtful gifts for important life events.

• Translate complex business needs into clear requirements, user stories, and scalable solutions • Collaborate with Product Owners and tech teams to shape AI-driven product use cases • Analyze user needs and drive data-driven product improvements (incl. A/B testing) • Own end-to-end delivery: planning, timelines, risks, and execution • Lead agile ceremonies and ensure on-time, high-quality delivery • Support development of AI solutions, frameworks, and innovative use cases • Act as a bridge between business and engineering to ensure alignment and clarity • Drive stakeholder communication, remove blockers, and enable continuous improvement

• Work closely with product feature teams to understand their roadmap and translate initiative goals into data KPIs, targets, and measurement plans. • Extract and integrate data from various sources to support analytical efforts, coordinating with data product, engineering, data science, and other analytics teams as needed. • Lead A/B test experiments, validate test data, monitor progress, perform post-test analysis, and provide recommendations for feature release decisions, collaborating with the experimentation platform team as necessary. • Convert business questions into data analytics tasks, conduct thorough analyses to segment and explore data, identify key drivers, and generate actionable insights to inform business decisions. • Collaborate with data scientists on research and innovation, applying standardized processes and enhancing analytics methodologies as they become available. Contribute to the development and use of digital tools, reporting visualization, and analytical storytelling. • Work with the reporting team to define and create automated and self-serve dashboards, providing relevant information efficiently to optimize business operations and track key initiatives.

Role Description A sua missão: - Irá atuar na diretoria de IA com foco na gestão de uma frente de produtos de automação inteligente. - Operar a gestão contínua desses produtos a partir de dados — interpretando o comportamento dos funis, identificando oportunidades e problemas, priorizando e acompanhando o roadmap da frente. - Transformar dado em decisão e decisão em ação, atuando como elo entre os números, a Engenharia e as áreas de Operações. - Garantir que o roadmap reflita o que de fato move resultado para o cliente e para a operação. Como será o seu dia a dia: - Acompanhar e interpretar os indicadores e funis de conversão dos produtos, separando sinal de ruído. - Investigar anomalias até a causa raiz, retornando com diagnóstico e recomendação de ação. - Gerir o roadmap da frente: priorizar com base em volume, impacto e viabilidade. - Cruzar continuamente os achados dos dados com o roadmap vigente, identificando gaps e prioridades desatualizadas. - Validar hipóteses e achados com as áreas de Operações e com a Engenharia. - Acompanhar prazos e entregas dos itens priorizados, medindo o resultado pós-entrega. - Sustentar o ritmo de gestão da frente: leitura recorrente dos indicadores e preparação de materiais de acompanhamento. - Estimar o efeito esperado de iniciativas sobre os resultados do produto. - Identificar oportunidades de melhoria na jornada do cliente a partir dos padrões de fricção observados nos dados. - Comunicar de forma clara e objetiva conceitos analíticos e de produto para diferentes públicos. - Trabalhar com autonomia na investigação e na gestão da frente. - Priorizar tarefas importantes e garantir comunicação eficiente com pares e liderança. Qualifications - Ensino superior completo (Administração, Engenharia, Economia, Sistemas de Informação e áreas correlatas). - Domínio de SQL como ferramenta de investigação. - Experiência relevante com gestão por métricas e análise de funil de conversão em produtos digitais. - Experiência em produto B2B ou de natureza operacional. - Capacidade analítica comprovada: diagnóstico de causa raiz, leitura crítica de dados e ceticismo metodológico. - Traquejo com stakeholders técnicos e operacionais. - Julgamento de priorização: distinguir o que importa do que apenas aparece no dado. - Conhecimento de metodologias ágeis e gestão de roadmap. Requirements - Vivência em produtos com IA não-determinística. - Conhecimento do domínio contábil/fiscal. - Cases de decisão de produto tomada a partir de análise própria. Benefits - Plano de Saúde; - Plano Dental; - Psicoterapia Online; - TotalPass; - Seguro de Vida; - Vale Alimentação e Vale Refeição (VA/VR); - Parcerias de Desconto (Universidade e Escolas de Idiomas); - Despreocupe-se - Seguros Diversos; - No dress code;