ML Applied Scientist

Location

United States

Posted

10 days ago

Salary

0

Seniority

Mid Level

Job Description

ML Applied Scientist

Grid Dynamics Holdings

Role Description We are seeking an experienced ML Engineer to join our team to build and scale automated evaluation and synthetic data generation (SDG) capabilities that support safety assessments across languages and markets. You will play a crucial role in training automated judges, developing validation techniques, building automated performance checks, and creating scalable approaches to analysis and reporting. You will be part of a team who works closely with language experts and multi-lingual annotators to validate automated approaches to safety evaluations, across diverse linguistic contexts. - Automated Judge Development: - Train, fine-tune, and validate automated judge models that can reliably score AI system outputs for safety and policy compliance. - Develop calibration and agreement metrics to ensure judges meet human-parity benchmarks. - Validation Techniques: - Design and implement validation frameworks to assess the accuracy, reliability, and cross-linguistic consistency of automated evaluation systems. - Develop methods to detect drift, bias, and failure modes in automated judges across markets. - Synthetic Data Generation: - Develop and maintain synthetic data generation pipelines to augment evaluation coverage, stress-test safety boundaries, and support evaluation in low-resource languages. - Ensure synthetic data is diverse, representative, and validated against human-generated benchmarks. - Scalable Analysis & Reporting Automation: - Create automated pipelines for analysis and reporting that reduce manual effort, increase reproducibility, and enable rapid cross-market safety assessments. - Build tooling that integrates with existing dashboards and reporting workflows. Qualifications - 3+ years of experience in an ML engineering or applied ML research role, with hands-on experience building and deploying ML models and pipelines. - Strong proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face Transformers). - Experience training, fine-tuning, and evaluating language models and/or classifiers, including prompt engineering and model calibration. - Experience building automated data processing, evaluation, or monitoring pipelines. - Comfortable with experiment design and statistical validation of model performance across segmented samples. - Able to work independently as well as collaboratively with minimal direction. - Organized, highly attentive to detail, and manages time well. - Experience with synthetic data generation techniques, including data augmentation, paraphrasing, and controlled generation methods. - Experience with multilingual NLP, cross-lingual transfer learning, or low-resource language modeling. - Familiarity with evaluation-as-a-service architectures or automated red teaming frameworks. - Experience with large-scale distributed computing (e.g., Spark, Ray, or cloud-based ML platforms). - Prior experience in AI safety, responsible AI, content moderation, or trust and safety domains. - Experience with CI/CD integration for ML model validation and deployment. - Advanced degree (MS/PhD) in Computer Science, Machine Learning, Natural Language Processing, or a related field. Benefits - Opportunity to work on cutting-edge projects. - Work with a highly motivated and dedicated team. - Competitive salary. - Flexible schedule. - Benefits package - medical insurance, vision, dental, etc. - Corporate social events. - Professional development opportunities. - Well-equipped office.

Related Categories

Related Job Pages

More Research Scientist Jobs

IonQ logo

Senior Research Scientist - Fault Tolerant Quantum Algorithms

IonQ

Our mission: to build the world’s best quantum computers to solve the world’s most complex problems.

Full TimeRemoteTeam 201-500Since 2015H1B Sponsor

Role Description We are looking for a Senior Research Scientist – Fault-Tolerant Quantum Algorithms to join a cross-functional team that uses IonQ’s quantum computers to create highly differentiated quantum solutions that will bring value to society. As a Senior Research Scientist – Fault-Tolerant Quantum Algorithms, you’ll be part of a multi-generational journey to solve the world’s most complex problems using the world’s best quantum computers built at IonQ. As a deep technical expert on fault-tolerant algorithms, you will help develop next generation quantum algorithms that are poised to exceed state-of-the-art classical methods. You will develop core IP, computational resource models, implementation libraries, long-term roadmaps, and end-to-end workflows that have the potential to disrupt the field of computing. You will also work closely with internal and external customers/partners to brainstorm new ideas, contribute to multi-year initiatives, and represent IonQ at high-visibility technical conferences (often all in a single day)! Responsibilities: - Develop fault-tolerant quantum solutions that can make a large scientific and commercial impact across a wide range of industry verticals. - Be part of a client-facing team that finds, defines, and solves problems of real-world interest using IonQ trapped-ion quantum computers. - Contribute technical expertise toward comparisons of FTQC algorithms vs NISQ algorithms vs classical HPC algorithms. - Contribute knowledge of metrics and tools (classical and quantum) to evaluate and communicate pros/cons, current state-of-the-art, scaling behavior, trade offs, cross-over points, etc. - Discover foundational IP and publish results in high-impact-factor peer-reviewed journals and conferences. Qualifications - 2+ years of professional experience or an equivalent combination of education and experience. - Documented expertise in FTQC algorithms with line-of-sight to end-customer value i.e. millions of qubits, billions of gates. - Ability to contribute to the FTQC algorithm community, including the development of tools (libraries, simulators, compilers), metrics (costing, resource estimation, ROI) and community (economic development, standards). - Relentless dedication to optimizing algorithm performance (accuracy, time-to-solution) through elegant theoretical equations, as well as engineering optimization and implementation. - Proven track record of domain expertise in fault-tolerant quantum computing, demonstrated through invited talks, repos, licenses, publications, and/or patents. - Experience being part of a team that finds, defines, and solves problems of real-world interest. Good team player with excellent communication skills. Requirements - Ph.D. in computer science, math, engineering, physics, or related fields. - Experience supporting writing and executing on government contracts. - Demonstrated expertise in C++, Python, Qiskit or similar quantum SDK. - Demonstrated experience benchmarking quantum algorithms using varied metrics. - Success working directly with customers to define and deliver solutions. - Experience developing hybrid end-to-end solutions in a production or cloud environment; knowledge of CI/CD a plus. Benefits - Comprehensive medical, dental, and vision plans. - Matching 401(k). - Unlimited PTO and paid holidays. - Parental/adoption leave. - Legal insurance. - Home technology stipend.

United States + 2 moreAll locations: United States | Canada | Sweden
$145.9K - $191.0K / year
WestEd logo

Quantitative Research Assistant

WestEd

WestEd is a nonprofit research, development, and service organization committed to improving education, promoting excellence, and achieving equality for childre

• coordinate and schedule research activities such as interviews, focus groups, and survey administrations; cultivate and sustain strategic partnerships with internal and external teams; assist with participant recruitment and incentive management. • maintain data collection and implementation measurement systems to monitor program quality; participate in various data collection efforts (e.g., focus group, surveys, interviews, etc.); conduct user needs assessments and use data-driven frameworks to guide continuous product iteration. • build, maintain, clean, and manage large datasets (e.g., Common Core of Data school directory files, client implementation databases, etc.) using Stata, R or another statistical software package; effectively summarize descriptive data for client products, dissemination, and annual reports. • contribute to the and writing of small-to-large project reports and proposals; assist in the preparation and submission of large and small proposals. • present project work to internal project teams; interface with research participants related to data collection, analyses and reports; communicate effectively with internal colleagues about project needs, including IRB, the Data Protection Office, and Accounting.

California
$71.2K - $89K / year
Full TimeRemoteTeam 501-1,000H1B No Sponsor

• Building a free, user-friendly web platform for researchers to upload memory responses • Designing and building an interface that hosts multiple scoring models • Curating datasets and fine-tuning language models for scoring • Evaluating models' scores against expert ratings • Administrative tasks and writing as necessary

Massachusetts
$24 / hour
OneStream Software logo

Senior User Experience Researcher II

OneStream Software

A comprehensive cloud-based platform to modernize the Office of the CFO.

Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Assess our product landscape and propose a UX Metrics approach. • Oversee evaluative and generative research studies, sometimes performing original research, and often enabling others to do so. • Define research strategies and methodologies aligned with business goals and product roadmaps. • Mentor and guide our associate researcher and our designers in best practices for user research and usability testing, teaching them new methods and giving feedback on their research work. • Establish best practices and guardrails for responsible AI use in UX research, including validation of AI-generated outputs, protection of customer data, and clear documentation of research methodology. • Collaborate with Design, Engineering, and Product to identify research questions and methods and help solve business and customer needs. • Continue building up the long-term panel of customer participants we have started drawing on; oversee logistics and ensure representative samples. • Present research findings and recommendations to stakeholders at all levels, influencing product strategy and design decisions. • Champion a culture of continuous learning and iteration, advocating for user needs throughout the product lifecycle. • Support research operations, including tools, templates, and reporting.

United States
$173K - $225K / year