OpenRouter logo
OpenRouter

LLM router and marketplace

Research Scientist

Research ScientistResearch ScientistFull TimeRemoteSeniorTeam 1-10Since 2023H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

0

Seniority

Senior

Postgraduate DegreeEnglishBigQueryPythonSQL

Job Description

Research Scientist

OpenRouter

• Own and pursue a research agenda focused on LLM evaluation, model quality, routing optimization, and AI usage patterns, contributing original insights that advance the field. • Design novel evaluation frameworks and benchmarks that go beyond standard leaderboards, using real-world generation data to capture how models actually perform across tasks and contexts. • Conduct large-scale empirical studies on LLM behavior: how models compare across providers, how performance changes over time, and how usage patterns reveal strengths and weaknesses. • Develop the statistical and mathematical foundations behind our routing systems, building the models and heuristics that power intelligent provider and model selection. • Identify opportunities to apply research findings to feed back into OpenRouter's product and platform. • Collaborate with external researchers, model providers, and the open-source community to advance shared understanding of LLM capabilities and limitations. • Work with product and engineering teams to translate research findings into improvements to OpenRouter's platform, without being constrained to a shipping cadence.

Job Requirements

  • MS or PhD in a quantitative field (machine learning, statistics, computer science, mathematics, computational linguistics, or similar).
  • Track record of original research, demonstrated by first-author publications, significant open-source contributions, or equivalent impact in industry research.
  • Deep expertise in statistics, experimental design, and causal inference. You can design rigorous studies and reason carefully about validity, bias, and generalizability.
  • Strong programming skills in Python. You can build data pipelines, run large-scale experiments, and prototype models efficiently.
  • Proficiency in SQL for working with large-scale analytical databases (ClickHouse, BigQuery, or similar).
  • Hands-on experience with modern ML/NLP techniques such as LLM evaluation, fine-tuning, embeddings, classification, or reinforcement learning from human feedback.
  • Familiarity with the current LLM landscape: model architectures, provider ecosystems, benchmark suites, and the strengths and limitations of leading models.

Benefits

  • Health insurance
  • Flexible working arrangements
  • Professional development opportunities

Related Categories

Related Job Pages

More Research Scientist Jobs

Digital Science logo

Senior Vice President, Researcher Growth

Digital Science

Advancing the research ecosystem. Together, we make open, collaborative and inclusive research possible.

Full TimeRemoteTeam 501-1,000Since 2015H1B Sponsor

• Define and execute Digital Science's researcher growth strategy, ensuring the channel delivers measurable contribution to company and segment growth objectives. • Build the programs and operating models that convert researcher engagement into commercial outcomes — from first adoption through retention and cross-product expansion. • Partner with Product, Marketing, and segment leaders (Academic, Enterprise, Government, Publisher) to prioritize investments and align initiatives with market priorities. • Build and scale a global researcher community — including ambassador and advocacy programs — that drives awareness, engagement, and commercial growth. • Develop and optimize direct-to-researcher commercial motions that convert engagement into revenue, pipeline, institutional demand, and customer expansion. • Monitor channel performance against targets, flagging risks early and acting decisively. • Build alignment across market, product, marketing, and commercial leaders, establishing shared goals and operating rhythms for coordinated execution. • Define the metrics that quantify the channel's contribution — revenue, pipeline, conversion, retention, lifetime value, cross-product adoption, and community engagement — and drive continuous improvement through experimentation and analysis. • As a member of the Commercial Leadership Team, embed researcher engagement into portfolio planning and product investment decisions, serving as the executive voice for researcher growth at the highest levels of the company.

United States
Humana logo

Research Scientist

Humana

Louisville, Kentucky-based Humana is a leading healthcare company that offers a variety of health, wellness, and insurance products and services designed to off

• Research, prototype and scale new ideas to improve population health and healthcare delivery • Collaborate with analytic and business teams to set objectives, approaches, and work plans • Collaborate with strategy to evaluate existing programs and identify and measure new solutions to impact healthcare • Leverage a wide range of analytics methods ranging from descriptive to prescriptive to transform high volumes of complex data into analytics solutions and actional insights • Collaborate with clinicians and clinical informaticists to define various clinical concepts and extract clinical information from medical, pharmacy, and lab claims for analytics and modeling purposes • Translates analytic results into key takeaways and make recommendations to business partners • Understands department, segment, and organizational strategy and operating objectives, and translate the strategy to work priorities • Make decisions regarding own work methods, occasionally in ambiguous situations with general guidance

United States
$78.4K - $107.8K / year
Sartorius logo

Principal Scientist – Extractables, Leachables (E&L)

Sartorius

A Trusted Partner of Life Sciences Research and Biopharmaceutical Manufacturing | #SimplifyingProgress

Full TimeRemoteTeam 10,001+H1B Sponsor

• Define and execute the strategy of the Extractables & Leachables technology area in alignment with Product and Technology Roadmaps to influence business direction • Drive the evolution of science-based and proactive E&L approaches, moving beyond reactive compliance and reducing experimental burden through predictive methodologies • Develop and advance mechanistic and data-driven E&L methodologies, including predictive models and integration of toxicological data into risk and safety frameworks • Evaluate emerging industry trends, regulatory developments, and state-of-the-art technologies to identify innovation opportunities and guide scientific direction • Act as internal and external Key Opinion Leader, contributing to industry consortia, regulatory initiatives, scientific publications, and conference presentations • Lead high-level technical discussions with customers and contribute to product qualification strategies, ensuring strong customer value creation and differentiation • Build and leverage internal and external networks while coaching and mentoring scientists and ensuring knowledge transfer across teams and functions

Germany

Role Description EUMETSAT is currently looking for an experienced Remote Sensing Scientist to join our international team contributing to the L1 geometric processing aspects for EUMETSAT’s Geostationary and Low Earth Orbit Missions. This role focuses on the analysis and optimisation of image navigation and registration performance, including geometric monitoring and quality assessment of L1 products. The Remote Sensing Scientist – Image Navigation and Registration Scientist is responsible for the scientific development, validation, and operational support of Level-1 (L1) remote sensing products for current and future satellite missions. The post holder provides scientific support to operational data processing activities to ensure the reliable and timely generation of products. - Develop and maintain scientific software tools, primarily in Python, for performance monitoring, anomaly investigation, and algorithm evolution. - Analyse large datasets, work with databases, and assess the impact of instrument and platform characteristics on geometric processing performance and product quality. Qualifications - An advanced university degree (Master’s or PhD) in Remote Sensing, Physics, Meteorology, Engineering or related disciplines. Requirements - Acquire and maintain an in-depth understanding of the imagers, infrared Fourier Transform Spectrometers, polarimeters and imaging spectrometers of current (EPS, MSG, MTG-I, Sentinel-3, MTG-S, EPS-SG) and future (CO2M and next generation GEO/LEO) satellite systems and of their Level-1 algorithmic processing and geometric performances. - Develop and apply data analysis and image processing methods (primarily using Python) to assess geometric performances and support operational Level-1 processor improvements for operational satellite programmes. - Support the maintenance, enhancements, testing and validation of the Level-1 processing systems for current and future missions, including monitoring performance, resolving processing anomalies and evolving Level-1 processing specifications. - Support the design, implementation, maintenance, and continuous improvement of geometric performance tools for commissioning, calibration/validation (Cal/Val), and routine operations. Skills and Experience - Good theoretical knowledge of remote sensing physics relevant to measurements of optical instruments. - Proven experience in developing scientific application software using Python. Familiarity with databases and additional expertise in general-purpose programming languages (such as C++ and Java) is an advantage. - Familiarity with spaceborne Image Navigation and Registration (INR), rectification, and geometric image quality assessment methodologies and techniques is an advantage. - Demonstrated experience of working with optical imaging instruments Level-1 algorithmic processing, in the development or the operational phase. - Excellent analytical, synthesis, and presentation skills, paired with strong interpersonal abilities and a proven track record of successfully applying these skills within teams and across multidisciplinary collaborations. Employment Conditions - The initial contract will be of 4 years’ duration, with subsequent 5 year contracts being awarded thereafter, subject to individual performance and organisation requirements. - This post is graded A2/A4 on the EUMETSAT salary scales. The minimum basic salary for this post is EURO 7,553 per month (net of internal tax but excluding pension contribution and insurances) which may be negotiable on the basis of skills and experience. - In addition to basic salary, EUMETSAT offers attractive benefits.

Germany + 9 moreAll locations: Germany | France | Estonia | Belgium | Finland | Denmark | Bulgaria | Czechia | Croatia | Austria
€7.6K / month