Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services
Product Data Scientist – AI Evaluation, Quality
Location
Lithuania
Posted
3 days ago
Salary
0
Seniority
Senior
Job Description
Product Data Scientist – AI Evaluation, Quality
Finom
• Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics • Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency • Close the production feedback loop by mining failure patterns from real traffic and proposing fixes • Harden methodology: judge stability and non-determinism handling • Translate numbers into decisions in weekly syncs with clear trade-offs
Job Requirements
- Python and SQL — you can build an analysis end-to-end
- Solid foundation in statistics — sampling, hypothesis testing, variance, understanding what a noisy metric is
- Analytical mindset — you start from the business question, not from the tool
- 3+ years in analyst / data scientist roles, at least one in a product context
- Experience in quality analytics for ML systems is a plus
- Hands-on experience evaluating LLM applications is a plus
- Experience building LLM agents is a plus
Benefits
- Make a genuine impact on the product
- Join our upward trajectory, and grow with us
- Provide resources and opportunities for continuous personal and professional development
- Enjoy flexibility of traveling and working remotely or in a hybrid model across Europe
- Become a stock options holder through Stock Options Program
- Receive unwavering support and care from Finom
- Participate in exclusive Work & Swim Program
- Modern, friendly, and eco-conscious corporate culture
- Equal Opportunity employer valuing diversity
Related Guides
Related Categories
Related Job Pages
More Data Scientist Jobs
Senior Data Scientist - Gen AI & NLP
Tiger Analytics Inc.Tiger Analytics is a fast-growing advanced analytics consulting firm, recognized as a trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data.
Role Description Tiger Analytics is looking for experienced Data Scientists GenAI to join our fast-growing advanced analytics consulting firm. We are seeking a highly skilled and experienced Lead Data Scientist with strong expertise in GenAI modelling. The ideal candidate will have a proven track record of designing, developing, and deploying scalable GenAI solutions, while leading projects and mentoring teams. This role requires deep technical expertise, hands-on coding experience, and the ability to collaborate closely with clients and stakeholders to translate business needs into robust analytical solutions. - Work on the latest applications of data science to solve business problems - Work directly with client stakeholders to translate business problems into high level analytics solution designs - Present analytic solutions to business audiences highlighting robustness of the solution and how it could help generate business value - Develop end-to-end solutions based on in-depth understanding of business problems to ensure analytics solutions are delivered efficiently, predictably, and sustainably - Design and develop machine learning and Generative AI solutions using RAG - Build LLM-powered applications leveraging Azure OpenAI and orchestrate workflows using LangGraph - Develop agentic AI workflows for automation, insights generation, and decision support - Implement Document Intelligence solutions for extracting insights from unstructured data - Participate in discussions with team members to select and apply relevant analytic techniques and create actionable business insights - Responsible for making presentations to senior management, communicating results to business teams, and develop plans to help operationalize analytic solution Qualifications - 7+ years of experience working as a GenAI Data Scientist - Proficiency in Python and SQL - Experience with MLflow and model lifecycle management - Experience with Python from a functional programming paradigm, able to manage dependencies and virtual environments, along with version control in git - Generative AI Knowledge: Solid understanding of latest-generation AI concepts including LLMs, prompt engineering, retrieval-augmented generation (RAG), and other contemporary generative AI applications - Experience with sequential algorithms (e.g., LSTM, RNN, transformer, etc.) - Experience with Bedrock, JumpStart, HuggingFace - Experience evaluating ethical implications of AI and controlling for them (e.g., red-teaming) - Expertise in supervised learning and unsupervised learning along with experience in deep learning and transfer learning - Experience in generative algorithms (e.g., GAN, VAE, etc.) as well as pre-trained models (e.g., LLaMa, SAM, etc.) - Experience developing models from inception to deployment - 5-10 years of professional work experience with at least 5 years in Data Science - Experience building end-to-end ML pipelines in production - Familiarity with CI/CD pipelines, monitoring, and model governance - Ability to design scalable and reliable AI systems - Bachelor's in Business Analytics or equivalent work experience Benefits - Significant career development opportunities exist as the company grows - The position offers a unique opportunity to be part of a small, fast-growing, challenging and entrepreneurial environment, with a high degree of individual responsibility Company Description Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.
Senior Data Scientist
Zup InnovationWe create digital assets to build, grow and accelerate your applications with efficiency, security and scalability.
• Support technical and product decisions as a reference in Machine Learning/Artificial Intelligence, with a strong emphasis on NLP (Natural Language Processing) and LLMs (Large Language Models). • Design, implement and maintain data and ML pipelines, covering training, evaluation and inference, always focusing on performance, reliability and best practices. • Integrate traditional Machine Learning techniques with other AI solutions to solve complex, business-specific challenges. • Propose and implement technological innovations involving NLP, LLMs and cloud solutions (AWS). • Ensure that deliveries are robust, scalable and have measurable impact, preferably applying solutions in Big Data environments. • Actively collaborate with product, engineering and business teams, translating problems into AI/NLP solutions that generate real, measurable value.
• The Senior AI Data Scientist is a senior individual contributor role within Data Science, AI, & Agentic. This role is responsible for leading complex analytical, predictive, and applied AI workstreams, operating with a high degree of independence and serving as a trusted advisor on data science and AI strategy. • This role focuses on shaping and executing advanced modeling, experimentation, and applied AI solutions that address high-value business problems. The Senior AI Data Scientist translates ambiguous stakeholder needs into structured analytical approaches, model designs, evaluation frameworks, and actionable insights. They partner closely with cross-functional teams and stakeholders to ensure that analytical and AI-driven solutions are both technically sound and practically impactful. • At this level, the role combines strong quantitative expertise with deep modeling capability, rigorous experimentation practices, and thoughtful application of AI methods. The Senior AI Data Scientist influences analytical direction, improves delivery quality through best practices and reusable approaches, and elevates the overall effectiveness of data science workstreams across engagements.
• Operate and evolve the data platform (Databricks, Unity Catalog, data lake), ensuring availability, performance and cost control • Lead the full data lifecycle — ingestion, ETL/ELT and enablement — supporting billing and adoption pipelines with reliability and integrity • Establish and enforce data best practices: Governance, Modeling, Quality, Security & Privacy, Lineage and Accessibility • Define the team roadmap and prioritize requests, balancing competing needs of technical and business stakeholders • Collaborate with stakeholders to document clear data requirements and validate products with users • Monitor metrics and KPIs to guide decisions and drive continuous improvement of data products • Support the incorporation of AI into the team's workflows to accelerate performance • Lead and develop a cross-functional team of engineers, data scientists and analytics specialists — attracting, retaining and mentoring talent • Ensure billing and adoption pipelines operate with integrity, reliability and efficiency • Identify opportunities to scale and optimize the data operation



