Self-described as the leading platform for search-powered solutions, Elastic helps organizations, their customers, and their employees find what they need faster while protecting a
Principal Data Scientist - Agent Builder
Location
Ukraine + 6 moreAll locations: Ukraine | Russia | Belarus | Cuba | Iran | North Korea | Syria
Posted
7 days ago
Salary
0
Seniority
Lead
Job Description
Principal Data Scientist - Agent Builder
Elastic
Role Description The Search Conversational Experiences team builds Elastic’s new conversational and agentic platform that lets customers chat with their own data in Elasticsearch. We build the core quality layer for RAG, agents and tools, retrieval and citations, streaming, memory, and the evaluation signals that turn open-ended questions into grounded, reliable answers. As a Principal Data Scientist, you will help set the technical direction for how we evaluate, improve, and scale chat quality across Elastic’s agentic platform. You will define the evaluation strategy that guides product decisions, including: - Which models we standardize on - How we route requests across agents - Which tools we enable and when - How we tailor agents to different Elastic use cases in search and beyond You will work closely with backend engineering, product, UX, and other data scientists to turn ambiguous, cutting-edge problems into measurable product improvements. You’ll help lead work on frontier problems such as: - Folding RAG and vector search into an agent’s knowledge base - Dynamically enriching model context to improve groundedness - Shaping reasoning strategies and tool-selection policies - Lighting up agent-driven visualizations on top of Elasticsearch data - Exploring multimodality where it can create meaningful user value This is an applied leadership role: you will prototype, evaluate, influence roadmap direction, and help teams ship improvements that customers can feel. Qualifications - 8+ years of applied DS/ML experience, with deep expertise in IR, NLP, ranking, semantic search, RAG, or LLM-powered product experiences. - Strong track record defining and leading evaluation for production AI/ML systems, including offline metrics, online experimentation, LLM-as-judge approaches, groundedness, citation quality, and model comparison. - Experience influencing product and technical strategy through data, especially in ambiguous or emerging domains where the “right” metric or approach is not obvious at the start. - Hands-on ability with Python, PyTorch/Transformers, Pandas, notebooks, reproducible experiments, versioned datasets, and clean, reviewable code. - Strong understanding of retrieval systems, including dense and sparse retrieval, re-ranking, vector search, query understanding, and evaluation metrics such as nDCG, MRR, Recall@k, precision, and latency/cost trade-offs. - Experience collaborating closely with engineering teams to move from prototype to production, including telemetry design, dashboards, CI guardrails, and quality regression tracking. - Practical Elasticsearch experience, or experience with similar search and distributed data systems. ES|QL familiarity is a plus. - Excellent written and verbal communication, with the ability to explain complex scientific and technical trade-offs to engineering, product, design, and leadership audiences. - A collaborative, low-ego style and a strong ability to mentor, raise standards, and develop transparency for others in a distributed team. Requirements - Define the evaluation strategy for conversational and agentic search, including offline and online evaluation, golden datasets, rubrics, LLM-as-judge calibration, groundedness and citation checks, and A/B testing. - Lead the design of quality metrics and decision frameworks for RAG, agents, tools, model selection, agent routing, prompt behavior, and cost/latency trade-offs. - Build, compare, and guide improvements across retrieval and re-ranking approaches, including sparse and dense retrieval, vector search, query understanding, semantic rewrites, and context enrichment. - Turn experimental results into product and business decisions: which models to use, how to route requests efficiently, which tools should be exposed, and how agents should be customized for different Elastic use cases. - Partner with engineering to productionize evaluation pipelines, telemetry, dashboards, CI guardrails, and regression detection for chat quality, helpfulness, dedication, latency, and cost. - Influence the roadmap by identifying the highest-leverage quality gaps, proposing practical solutions, and communicating trade-offs clearly to product, engineering, and leadership. - Mentor other data scientists and engineers in experiment design, evaluation methodology, statistical rigor, and practical approaches to improving LLM-powered systems. - Share outcomes through clear docs, notebooks, PRs, dashboards, technical proposals, and cross-functional reviews. Benefits - Competitive pay based on the work you do here and not your previous salary. - Health coverage for you and your family in many locations. - Ability to craft your calendar with flexible locations and schedules for many roles. - Generous number of vacation days each year. - Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service. - Up to 40 hours each year to use toward volunteer projects you love. - Embracing parenthood with a minimum of 16 weeks of parental leave.
Related Guides
Related Categories
Related Job Pages
More Data Scientist Jobs
Paid Ads - Online Advertising on Facebook / Instagram - Performance / Data-Driven Marketing
Hommel HiredHommel Hired is a value-driven, Recruiting-as-a-Service partner for remote-first companies and founders. We specialize in finding talent that not only meets the skills required but also deeply aligns with a company’s culture and values. By combining modern sourcing methods, data-driven processes, and a personalized approach, we help fast-growing startups and SaaS businesses build high-performing teams that thrive in a remote environment.
Role Description - Kommunikation: Hauptansprechpartner für den Kundenkontakt deiner Kunden und die regelmäßige Kommunikation. - Performance-Analyse: Kontinuierliche Performance-Analyse und Ableitung proaktiver Maßnahmen, um Kundenbedürfnisse zu erkennen und die Kundenzufriedenheit zu sichern. - Kampagnenoptimierung: Verantwortung für die kontinuierliche Kampagnenoptimierung, um die Ziele der Kunden zu erreichen. - Umfang: Eigenständige Betreuung eines Portfolios von typischerweise 2 großen und 4 bis 5 mittelgroßen Kunden. - Creative Briefings: Erstellung präziser Briefings für Creative-Teams. - Umsatzverantwortung: Übernahme der Verantwortung für die Kundenbindung und Umsatzsteigerung als zentrale Schnittstelle zur Agentur. Qualifications - Meta Ads Expertise: Fundiertes und tiefes Wissen in Meta Ads als K.O.-Kriterium. - Erfahrung: Nachweisliche Erfahrung in der eigenständigen Betreuung von Kunden im Performance Marketing. - Growth Mindset: Stark ausgeprägtes Growth Mindset und Interesse an neuen Tools und Entwicklungen in der Branche. - Selbstorganisation: Hohe Fähigkeit zur Selbstorganisation und Eigeninitiative, um in unserer freien Agenturstruktur erfolgreich zu sein. - Bonus - TikTok: Kenntnisse im Bereich TikTok Ads. Benefits - Arbeitsort: 100% Remote-Work und flexible Arbeitsweise. - Workation: Wie z.B. Paris, Prag oder Gardasee. - Kultur: Flache Hierarchien und die Chance, Verantwortung schnell zu übernehmen und eigene Prozesse zu gestalten. - Entwicklung: Regelmäßige Feedbackschleifen zur aktiven Förderung deiner Entwicklung.
Role Description So wirst du Teil der Zukunft: Datenkompetenz leicht gemacht. Wir sind die DataSmart Point Academy, ein spezialisierter Weiterbildungsträger mit Fokus auf digitale Zukunftskompetenzen. Unser Ziel: Menschen praxisnah für Data, Analytics und Künstliche Intelligenz qualifizieren – flexibel, modern und anerkannt. Unsere Weiterbildungen bereiten dich gezielt auf eine Karriere in Data Science, Business Analytics und AI vor. In 6, 8 oder 12 Monaten lernst du alles, was du für deinen Einstieg brauchst – mit anerkanntem IHK-Abschluss und praktischen Skills in Excel, SQL, Power BI und Python. Alles 100 % online, praxisorientiert und flexibel – ideal für deinen beruflichen Neustart oder nächsten Karriereschritt. - Business Analytics (6 Monate) - Tools: Excel, SQL, Power BI - Fokus: Geschäftsprozesse verstehen, Daten analysieren, Entscheidungen optimieren - Für dich, wenn du Wirtschaft, Strategie, Vertrieb oder Marketing liebst – ohne gleich Programmierer*in zu werden. - Data Science & Data Engineering (8 Monate) - Tools: Python, Pandas, Statistik, Machine Learning, APIs - Fokus: KI-Modelle bauen, Prozesse automatisieren, tief in die Technik eintauchen - Für dich, wenn du Technik-Fan bist und gerne mit Code arbeitest. - Data Analyst Qualifizierung (12 Monate) - Tools: Excel, SQL, Power BI, Python, KI & Machine Learning - Fokus: Komplettausbildung – vom ersten Excelsheet bis zum finalen ML-Modell - Für dich, wenn du dir alle Türen offenhalten und ein ganzheitliches Skillset aufbauen willst. Qualifications - IHK-Zertifikat für deinen Lebenslauf - Microsoft Power BI für professionelle Datenvisualisierung - 100% online & flexibel – ideal berufsbegleitend - Praxisprojekte statt trockener Theorie Requirements - Leidenschaft für Daten & neue Technologien – du hast Lust, die Datenwelt zu entdecken - Interesse an Wirtschaft, Prozessen oder Technik – je nach Kursfokus - Motivation & Lernbereitschaft – wir starten bei den Basics und führen dich Schritt für Schritt in die Welt der Daten ein - Grundlegende PC-Kenntnisse (Office, Internet, E-Mail) - Keine Programmierkenntnisse erforderlich – wir bringen dir alles bei, was du für den Einstieg brauchst - Gute Deutsch- oder Englischkenntnisse - Optional hilfreich: Erste Erfahrung mit Excel, Zahlen oder Analysen - Freude daran, Neues auszuprobieren und dich stetig weiterzuentwickeln Benefits - Anerkannter IHK-Abschluss – wertvolles Zertifikat für deinen Lebenslauf - Praxisnah & 100% online – flexibel lernen, auch neben dem Job - Microsoft Power BI & SQL – gefragte Tools, die sofort im Job einsetzbar sind - KI & Machine Learning – moderne Skills für die Arbeitswelt von morgen - Individuelle Kurswahl (6, 8 oder 12 Monate) – je nach Karriereziel & Tempo - Begleitung durch Expert*innen – persönliches Feedback & Projektarbeit - Karrierestart in wenigen Monaten – statt jahrelangem Studium
Temporary Intern, Data Scientist
CotivitiFounded in 1979, Cotiviti provides analytics-driven payment and network solutions for the healthcare and retail industries, offering services that help payers,
• Build and evaluate classification or regression models using Python and standard ML libraries • Engineer features from claims, clinical, or operational datasets • Clean, transform, and profile datasets; document data-quality findings and assumptions • Write SQL against relational databases to extract and shape analytical inputs • Build lightweight APIs or endpoints to surface model outputs (e.g., FastAPI) • Contribute to version-controlled, reproducible workflows using Git • Document pipelines so teammates can extend and audit your work • Assist with experiments at the intersection of ML and healthcare workflows
Operations Supervisor - Data Annotation / Machine Learning
Talent 360 MEEmpowering Businesses through People Success
Role Description We are seeking a detail-oriented and proactive Operations Specialist to support and optimize our day-to-day business operations. The ideal candidate will play a key role in improving processes, enhancing efficiency, and ensuring smooth coordination across departments. - Monitor and manage daily operational activities to ensure efficiency and quality standards - Analyze operational processes and identify areas for improvement - Coordinate with cross-functional teams including Product, Development, and Customer Support - Track KPIs and prepare regular performance reports for management - Assist in implementing new systems, tools, and workflows - Handle operational issues and provide timely resolutions - Maintain accurate documentation of processes and procedures - Support project execution and ensure deadlines are met Qualifications - Bachelor’s degree in Business Administration, Operations Management, or a related field - 2–4 years of experience in operations, preferably within a tech or software environment - Strong analytical and problem-solving skills - Excellent organizational and time management abilities - Strong communication and interpersonal skills - Proficiency in Microsoft Office and/or Google Workspace tools - Familiarity with project management tools (e.g., Jira, Trello, Asana) is a plus - Ability to work in a fast-paced and dynamic environment Benefits - Competitive salary and benefits package - Professional growth and development opportunities - Collaborative and supportive work environment - Opportunity to be part of a growing and innovative company
