Job Closed
This listing is no longer active.
Snorkel AI is a technology company focused on providing AI-driven solutions for its clients. The company aims to foster an inclusive workplace culture that emphasizes innovation, c
Research Scientist - RL Training
Location
United States
Posted
16 days ago
Salary
$200K - $325K / year
Seniority
Mid Level
Job Description
Research Scientist - RL Training
Snorkel AI
Role Description We're looking for a Research Scientist to work on reinforcement learning for training and aligning large language models. This is a foundational research role focused on one of the most consequential open data problems in AI: - How to generate the data, reward signals, and training procedures that steer LLM behavior in reliable and generalizable directions. - A core capability that directly differentiates Snorkel's data-as-a-service offering. You'll work closely with Snorkel's research, engineering, and delivery teams to advance our RL data capabilities: - Translating research ideas into the preference datasets, reward models, and RL-ready corpora we produce for frontier AI labs. - Contributing to a research agenda that is central to Snorkel's long-term differentiation as a provider of bespoke training data. Qualifications - Deep expertise in reinforcement learning from human or AI feedback, reward modeling, and credit attribution. - Experience training or fine-tuning 30B+ large language models at scale. - Strong proficiency in Python and ML frameworks, especially PyTorch and HuggingFace. - Solid software engineering fundamentals. - Familiarity with ML infrastructure and cloud platforms and tools (AWS, GCP, Kubernetes, Slurm, etc.). - Comfort operating in a high-iteration environment with open-ended research questions. - Ph.D. in machine learning, reinforcement learning, or a related field strongly preferred; exceptional industry experience considered. Requirements - Research and implement reinforcement learning techniques — including GRPO, RLHF, RLAIF, DPO, and reward modeling. - Design and build data pipelines that generate high-quality training signals for RL workflows. - Prototype and iterate on end-to-end RL training recipes. - Work closely with research scientists, ML engineers, and delivery teams. - Stay current with the latest developments in large-scale multi-node LLM training and alignment research. - Contribute to Snorkel's research publications and internal knowledge base in RL and model training. Benefits - Market proven solutions and robust funding. - Opportunities to shape priorities and initiatives. - Influence key strategic decisions and directly impact ongoing success. - Support in building your career in an environment designed for growth, learning, and shared success.
Related Guides
Related Categories
Related Job Pages
More Research Scientist Jobs
Principal Environmental Scientist
OnterrisFounded in 2012 and headquartered in North Little Rock, Arkansas, Onterris is a leading global environmental solutions provider—formerly known as Montrose Env
Title: Principal Environmental Scientist Location: California, United States Remote Full-time Job Description: About Us At Onterris, we build careers grounded in purpose, responsibility and real-world impact. "For Planet and Progress" is our north star that guides everything we do. We believe environmental responsibility and human progress are interconnected, interwoven and international. Our scientists, engineers, field teams, consultants and professionals collaborate across disciplines and geographies, guiding industries and governments, ensuring that communities and environments thrive. When you join us, you're not just forging a career, you're joining a movement. A movement for better thinking, smarter solutions and lasting impact. Together, we will advance our way of life and protect the integrity of our environment every step of the way. A Day in the Life Our Principal Scientist position can be performed remotely; however, the ideal candidate will be based in Southern California and bring strong California-specific regulatory and environmental expertise. The salary for this role ranges from $150,000 - $180,000, in addition to an annual bonus, commensurate with experience, skills, and geographic location To thrive in this role, you'll be comfortable taking ownership of the following responsibilities: - Leading complex environmental compliance projects from planning strategy through execution. - Working closely with clients and technical expert team and planners to solve problems and provide regulatory insight and risk-based guidance. - Collaborating with internal subject matter experts (biologists, archaeologists, GIS specialists, planners, regulatory specialists, and engineers) and external technical partners, protection agencies, and state or federal lead agencies. - Overseeing proposals and business development activities, including leading proposals, cost estimating, and interview execution. - QA/QC oversight of high-volume programs/projects. - Project staffing, budget and schedule management - Mentoring and developing staff, fostering technical excellence and professional growth. - Supporting business development and strategic growth initiatives alongside other Principals. - Maintaining compliance with all safety, confidentiality, and company policies. - Staying current on industry trends, regulations, and best practices through continuous professional development. - Working collaboratively with the core Principal team and working independently. - Perform other duties as assigned. Your Expertise and Skills The Principal Scientist is a recognized technical authority and strategic leader, responsible for regulatory certainty, project success, and long-term client trust. These requirements reflect the knowledge, skills and abilities that help you do your best work here. - Bachelor's degree in biology, urban planning, environmental science, or related field. - Master's degree preferred but not required. - Minimum of 15 years of relevant professional experience (12 years with a Master's degree). - Experience with utilities and/or renewable energy projects strongly preferred. - Experience serving as senior regulatory liaison with permitting agencies preferred. - Knowledge of current environmental compliance and city/state development regulations. - Strong familiarity with California natural resources and impact analyses/assessments. - Experience leading the regulatory permitting process, including experience working with the USACE, USFWS, BLM, USFS, CDFW, and RWQCB. - Proven ability to operate independently while leading multidisciplinary technical teams. - Experience as a people manager providing mentorship to elevate the skillsets of staff and provide career growth opportunities. - Proven success leading proposals and competitive pursuits. - Excellent written communication skills, ability to write and oversee complex technical documents, memorandum, or reports. - Experience leading projects/programs and working in dynamic, collaborative environments that require flexibility in assuming new roles and changing project directions. - Advanced proficiency with Microsoft Office; working knowledge of tools such as ArcGIS and AutoCAD preferred. - Willingness and ability to travel locally as needed. We are an Equal Opportunity Employer. We are committed to providing access and reasonable accommodation in our employment for individuals with disabilities. Onterris is a leading global environmental solutions company partnering with organizations to solve complex challenges where environmental pressures, regulatory expectations and operational risks intersect. Guided by our mission to advance the way of life without compromising the integrity of our environment, we believe environmental responsibility and human progress are fundamentally connected. Our scientists, engineers, field teams and consultants apply systems thinking that unites science, data and practical expertise to deliver solutions that strengthen our clients' resilience, mitigate risk and protect the air, water and soil that sustain communities, while uncovering responsible paths forward for planet and progress. For more information, visit www.onterris.com. We are an equal opportunity employer and encourage applications from people of all backgrounds. We acknowledge that these experiences and perspectives help to enrich our teams and contribute to our ongoing success. We are committed to providing access and reasonable accommodation in our employment for all applicants.
Research Scientist II
Citrine InformaticsTransforming materials and chemicals development through AI embedded in smart data infrastructure
• Perform high-quality technical work in materials informatics, including data processing, machine learning model building, and designing and executing active learning workflows • Rapidly adapt to new material domains and technical problems • Manage technical aspects of funded programs • Manage engagements with collaborators at universities, national labs, and other companies, including frequent and empathetic communication with collaborators • Aid in the preparation of responses to requests for proposals (RFPs) and actively explore and develop opportunities for research funding • Interface with Citrine’s other core technical teams to facilitate knowledge transfer to and from the External Research Department • Publish high-impact technical work in the form of peer-reviewed journal publications, case studies, and blog posts • Present at technical conferences and workshops and travel to collaborator institutions for program-related meetings
Senior Researcher, Employment and Economic Opportunity – Part-Time
American Institutes for ResearchAdvancing Evidence. Improving Lives.
• Manage day-to-day project operations in roles such as principal investigator, project director, or task lead. • Lead collaborative project teams by developing timelines, coordinating staff assignments, and ensuring deliverables are completed on time, within budget, and to a high standard. • Identify research problems and design studies to address key questions in applied research contexts. • Apply subject-matter expertise to design and implement relevant, responsive, and impactful research projects. • Develop study designs with aligned research questions, methodologies, and analytic plans. • Lead and contribute to research proposals for federal, state, foundation, and other clients. • Devise and implement innovative solutions to practical challenges in applied research. • Lead data collection and analysis efforts. • Oversee the design and planning of qualitative and/or quantitative data collection tools, such as interview protocols, focus group guides, and surveys. • Supervise field-based data collection activities, including interviews, observations, focus groups, and document reviews. • Conduct or oversee data analysis using appropriate tools and techniques for various data types. • Communicate study progress and findings clearly and effectively. • Prepare reports, briefs, visualizations, and other materials that interpret and present research findings for clients and stakeholders. • Represent the organization professionally in all client interactions. • Communicate effectively, both orally and in writing, with clients, partners, and stakeholders. • Foster and maintain positive, collaborative working relationships. • Manage client and stakeholder relationships with professionalism and awareness of the broader policy and practice landscape. • Contribute thoughtfully and creatively to project teams.
• Collects and analyzes complex research data, conducts experiments and interviews, and documents results according to established policies and procedures under general supervision • Serves as a unit subject matter expert and liaison to internal and external stakeholders providing advanced level information and representing the interests of a specialized research area • Identifies research problems and develops complex research methodologies and procedures • May supervise the day-to-day activities of a research unit as needed • Writes or assists in developing grant applications and proposals to secure research funding • Attends and assists with the facilitation of scholarly events and presentations in support of continued professional development and the dissemination of research information • Conducts literature reviews, prepares reports and materials, and disseminates information to appropriate entities • Monitors program budget and approves unit expenditures


