Finom logo
Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Product Data Scientist – AI Evaluation, Quality

Data ScientistData ScientistFull TimeRemoteSeniorTeam 501-1,000Since 2019H1B No SponsorCompany SiteLinkedIn

Location

Portugal

Posted

3 days ago

Salary

0

Seniority

Senior

Bachelor Degree3 yrs expEnglishPythonSQL

Job Description

Product Data Scientist – AI Evaluation, Quality

Finom

• Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics • Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency • Close the production feedback loop: mine failure patterns from real traffic → turn them into regression cases → propose fixes to Product and domain experts • Harden methodology: judge stability, non-determinism handling • Translate numbers into decisions – weekly syncs, clear trade-offs, no dashboards for their own sake

Job Requirements

  • Python and SQL — you can build an analysis end-to-end
  • Solid foundation in statistics — sampling, hypothesis testing, variance, understanding what a noisy metric is
  • Analytical mindset — you start from the business question, not from the tool
  • 3+ years in analyst / data scientist roles, at least one in a product context
  • Experience in quality analytics for ML systems — ranking, recommendations, classification, etc.
  • Hands-on experience evaluating LLM applications (RAG, agents, tool use, judges)
  • Experience building LLM agents — side projects, toy builds, personal experiments all count
  • AI-assisted coding is our default authoring environment
  • Fluent with AI coding or genuinely excited to become fluent fast
  • We care about what you ship and how clearly you think

Benefits

  • Make a genuine impact on the product
  • Join our upward trajectory
  • Continuous personal and professional development
  • Empowering you to make a genuine impact on our evolving product
  • Flexibility of traveling and working remotely or in a hybrid model across Europe
  • Become a stock options holder
  • Stock Options Program available to every team member
  • Constant support and care to ensure your Finom experience is successful and fulfilling
  • Work & Swim Program in Cyprus for work-life balance

Related Categories

Related Job Pages

More Data Scientist Jobs

Finom logo

Product Data Scientist – AI Evaluation, Quality

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Data Scientist3 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics • Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency • Close the production feedback loop: mine failure patterns from real traffic → turn them into regression cases → propose fixes to Product and domain experts • Harden methodology: judge stability, non-determinism handling • Translate numbers into decisions – weekly syncs, clear trade-offs, no dashboards for their own sake

Greece
Finom logo

Product Data Scientist – AI Evaluation, Quality

Finom

Financial solutions for entrepreneurs and freelancers - combining business account benefits with multiple services

Data Scientist3 days ago
Full TimeRemoteTeam 501-1,000Since 2019H1B No Sponsor

• Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics • Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency • Close the production feedback loop by mining failure patterns from real traffic and proposing fixes • Harden methodology: judge stability and non-determinism handling • Translate numbers into decisions in weekly syncs with clear trade-offs

Lithuania
Tiger Analytics Inc. logo

Senior Data Scientist - Gen AI & NLP

Tiger Analytics Inc.

Tiger Analytics is a fast-growing advanced analytics consulting firm, recognized as a trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data.

Data Scientist3 days ago

Role Description Tiger Analytics is looking for experienced Data Scientists GenAI to join our fast-growing advanced analytics consulting firm. We are seeking a highly skilled and experienced Lead Data Scientist with strong expertise in GenAI modelling. The ideal candidate will have a proven track record of designing, developing, and deploying scalable GenAI solutions, while leading projects and mentoring teams. This role requires deep technical expertise, hands-on coding experience, and the ability to collaborate closely with clients and stakeholders to translate business needs into robust analytical solutions. - Work on the latest applications of data science to solve business problems - Work directly with client stakeholders to translate business problems into high level analytics solution designs - Present analytic solutions to business audiences highlighting robustness of the solution and how it could help generate business value - Develop end-to-end solutions based on in-depth understanding of business problems to ensure analytics solutions are delivered efficiently, predictably, and sustainably - Design and develop machine learning and Generative AI solutions using RAG - Build LLM-powered applications leveraging Azure OpenAI and orchestrate workflows using LangGraph - Develop agentic AI workflows for automation, insights generation, and decision support - Implement Document Intelligence solutions for extracting insights from unstructured data - Participate in discussions with team members to select and apply relevant analytic techniques and create actionable business insights - Responsible for making presentations to senior management, communicating results to business teams, and develop plans to help operationalize analytic solution Qualifications - 7+ years of experience working as a GenAI Data Scientist - Proficiency in Python and SQL - Experience with MLflow and model lifecycle management - Experience with Python from a functional programming paradigm, able to manage dependencies and virtual environments, along with version control in git - Generative AI Knowledge: Solid understanding of latest-generation AI concepts including LLMs, prompt engineering, retrieval-augmented generation (RAG), and other contemporary generative AI applications - Experience with sequential algorithms (e.g., LSTM, RNN, transformer, etc.) - Experience with Bedrock, JumpStart, HuggingFace - Experience evaluating ethical implications of AI and controlling for them (e.g., red-teaming) - Expertise in supervised learning and unsupervised learning along with experience in deep learning and transfer learning - Experience in generative algorithms (e.g., GAN, VAE, etc.) as well as pre-trained models (e.g., LLaMa, SAM, etc.) - Experience developing models from inception to deployment - 5-10 years of professional work experience with at least 5 years in Data Science - Experience building end-to-end ML pipelines in production - Familiarity with CI/CD pipelines, monitoring, and model governance - Ability to design scalable and reliable AI systems - Bachelor's in Business Analytics or equivalent work experience Benefits - Significant career development opportunities exist as the company grows - The position offers a unique opportunity to be part of a small, fast-growing, challenging and entrepreneurial environment, with a high degree of individual responsibility Company Description Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Canada
Zup Innovation logo

Senior Data Scientist

Zup Innovation

We create digital assets to build, grow and accelerate your applications with efficiency, security and scalability.

Data Scientist3 days ago
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Support technical and product decisions as a reference in Machine Learning/Artificial Intelligence, with a strong emphasis on NLP (Natural Language Processing) and LLMs (Large Language Models). • Design, implement and maintain data and ML pipelines, covering training, evaluation and inference, always focusing on performance, reliability and best practices. • Integrate traditional Machine Learning techniques with other AI solutions to solve complex, business-specific challenges. • Propose and implement technological innovations involving NLP, LLMs and cloud solutions (AWS). • Ensure that deliveries are robust, scalable and have measurable impact, preferably applying solutions in Big Data environments. • Actively collaborate with product, engineering and business teams, translating problems into AI/NLP solutions that generate real, measurable value.

Brazil