Job Closed

This listing is no longer active.

Pathway logo
Pathway

pathway.com - The smartest way to build Data Products

AI Benchmark & Datasets Engineer – Internship

Location

France

Posted

90 days ago

Salary

0

Seniority

Entry Level

English

Job Description

AI Benchmark & Datasets Engineer – Internship

Pathway

• Proactively identify, prioritize, and curate relevant public and client-driven benchmarks across our target use cases and markets. • Evaluate candidate benchmarks for clarity, data quality, evaluation methodology, and fit with our model roadmap. • Run benchmarks with baseline models to validate setup, uncover edge cases, and de‑risk R&D runs. • Hand off “benchmark-ready” packages to R&D (specs, data, evaluation scripts, expected metrics, constraints). • Maintain a shared vocabulary and documentation around benchmarks, datasets, and evaluation formats that GTM and R&D can both use. • Track and organize benchmark results, model leaderboards, and “what good looks like” for different customers and scenarios. • Contribute to demos and public‑facing proof points based on benchmark outcomes.

Job Requirements

  • Cover letter
  • It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.
  • You are expected to meet at least one of the following criteria:
  • You were an ICPC World Finalist, or an IOI, IMO, IOAI or IPhO medalist in High School.
  • You have published a research paper at an A-rated o A*-rated venue (according to *ICORE*).
  • You have completed coding projects - ideally with a GitHub repository showcasing previous work.
  • You were an intern at a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA).
  • You can get a warm recommendation from you university faculty member.
  • Have experience with ML/LLM evaluation, data science, or technical product roles, ideally around benchmarks or experimentation.
  • Are comfortable reading papers, leaderboards, and Github repos, and turning them into clear, repeatable benchmark specs.
  • Can talk comfortably with both engineers and customers, and translate between technical detail and business value.
  • Care about high-quality data, reproducible experiments, and crisp documentation.
  • Are respectful of others.
  • Are fluent in English.

Benefits

  • Join an intellectually stimulating work environment.
  • During your internship, you will collaborate on a cutting edge research project.
  • Be a pioneer: you get to work with a new type of "Live AI" challenges.
  • Be part of one of an early-stage AI startup that believes in impactful research and foundational changes.

Related Job Pages

More Artificial Intelligence Jobs

Optum logo

Principal AI Data Analyst - Remote or Hybrid from MN or DC

Optum

Optum, part of the UnitedHealth Group family of businesses, is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. At Optum, we support your well-being with an understanding team, extensive benefits and rewarding opportunities. By joining us, you’ll have the resources to drive system transformation while we help you take care of your future. We recognize the power of connection to drive change, improve efficiency and make a difference in health care. Join a team where your skills and ideas can make an impact and where collaboration is key to creating technology that produces healthier outcomes.

OtherRemoteTeam 160,000Since 2011

Requisition Number: 2349553 Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. The Principle Event Data Analyst (AI & Advanced Analytics) is responsible for leading AI driven investigation and analysis of workplace incidents and data events using a systematic, analytics first approach. This role focuses on identifying impacted data at scale through automation, machine learning, and advanced analytics, while collaborating with cross functional teams including security, legal, privacy, and engineering. This role plays a key part in building and evolving an AI enabled investigative data platform, leveraging modern data lake architectures, distributed processing, and production AI/ML pipelines to accelerate insight generation and decision making. You'll enjoy the flexibility to work remotely * from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week. Primary Responsibilities: - Lead AI assisted analysis of data events and incident investigations using structured and unstructured data - Design and implement automated pipelines to ingest, normalize, deduplicate, enrich, and classify large scale datasets - Apply machine learning, entity resolution, and data fingerprinting techniques to identify impacted individuals and data elements - Build and maintain production analytics solutions using Python, PySpark, and Databricks - Develop and deploy AI driven workflows (including Generative AI use cases) to improve investigative speed, accuracy, and scalability - Secure, preserve, and validate data sources to maintain analytical integrity and evidentiary standards - Partner with security, legal, and privacy teams to translate complex analytical findings into clear, actionable insights - Create dashboards, visualizations, and analytical summaries for executive and technical stakeholders - Operate effectively in time sensitive environments while maintaining analytical rigor, objectivity, and confidentiality - Contribute to the evolution of Optum's AI and analytics capabilities within the cybersecurity and data protection space You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in. Required Qualifications: - Bachelor's degree or 6+ years of equivalent professional experience - 5+ years of experience in advanced data analytics, data science, or AI focused analytical roles - 5+ years of experience developing, testing, and deploying production grade Python code - 3+ years of experience with DevOps and CI/CD tooling (GitHub Actions, Docker, Kubernetes, Terraform) - 3+ years of experience with distributed data processing using PySpark and Databricks - Solid expertise in SQL, data modeling, and data integration - Experience working with data lake architectures and medallion schemas - Proven ability to translate analytical outputs into business and risk based insights Preferred Qualifications: - Advanced degree in Data Science, Computer Science, or a related field - Hands on experience with machine learning, predictive analytics, and classification models - Experience delivering AI driven analytics within a cybersecurity or incident response environment - Experience deploying Generative AI solutions into production analytics workflows - Experience with entity resolution, MDM technologies, or identity matching - Demonstrated familiarity with cloud platforms such as AWS, Azure, or Google Cloud - Experience building AI models for file classification, data fingerprinting, or anomaly detection - Demonstrated familiarity with eDiscovery platforms and large scale data investigations - Proven solid understanding of modern analytics platforms and scalable data architectures *All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy. Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $112,700 to $193,200 annually based on full-time employment. We comply with all minimum wage laws as applicable. Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected. Job posting may come down early due to volume of applicants. At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.

Minnesota
$112.7K - $193.2K / year
Job Closed
CACI International Inc logo

AI Context Engineer

CACI International Inc

Expertise and Technology for National Security

Full TimeRemoteTeam 10,001+Since 1962H1B No Sponsor

• Design and evolve AI-enabled development workflows • Prototype and evaluate approaches to context construction, summarization, and compression • Define and enforce standards for repository structure and organization for AI-assisted development • Evaluate and integrate AI tools • Serve as a technical authority on AI-enabled development practices • Train other team members on AI tools and workflows • Stay current with advancements in foundational models and AI coding tools

Virginia
$98.5K - $206.8K / year
Job Closed
HUCKEYE HEALTH SERVICES LLC logo

Psychiatrist

HUCKEYE HEALTH SERVICES LLC

To apply, please send the above requirements and your updated resume to: staffing@huckeyehealthcare.com

Role Description Remote Psychiatrist to provide high-quality psychiatric services in a telehealth setting. This is an excellent opportunity for a Board Certified or Board Eligible Psychiatrist looking for flexible remote work while supporting patients with timely psychiatric evaluations, medication management, follow-up care, and treatment planning. - Conduct psychiatric evaluations via telehealth - Diagnose and treat mental health conditions - Provide medication management and follow-up care - Develop and update individualized treatment plans Qualifications - MD or DO degree from an accredited institution - Board Certified or Board Eligible Psychiatrist - Active, unrestricted medical license - DEA registration, if required - Strong telehealth, communication, and documentation skills - Ability to work independently and maintain professional standards in a remote setting Requirements - Resume/CV - Active medical license - Board Certification / Board Eligibility - DEA (if applicable) Benefits - Rate: $200/hour - Location: Remote - Schedule: Flexible / based on assignment Company Description To apply, please send the above requirements and your updated resume to: staffing@huckeyehealthcare.com

Worldwide
$200 / hour

Role Description The Prior-Authorization Specialist at Prevea Health is responsible for obtaining and verifying prior authorizations within the appropriate timeline for procedures, diagnostic tests, services, and medications. This role ensures that all requests comply with insurance company policies, guidelines, and healthcare regulations. The specialist will collaborate with healthcare providers, patients, and insurance representatives to obtain the necessary approvals. - Identify and obtain what is required for preauthorization of procedures, diagnostic tests, services, and medications, seeing the process through completion to minimize denial of claims. - Coordinate with department providers and staff, coding/billing staff, and insurance representatives to ensure understanding of information needed to obtain proper authorization for payment within the appropriate timelines. - Review and interpret insurance coverage and policy guidelines to determine authorization requirements. - Communicate with patients as needed for procedures, diagnostic tests, services, and medications to provide them with information regarding their coverage. - Accurately document and communicate final determination in the patient's medical record and to appropriate staff, providers, or patient. - Work with internal teams to identify and address trends or issues in the prior authorization process. - Provide feedback and recommendations to improve prior authorization workflows and efficiency. Qualifications - High School Diploma and/or GED Required - 1-3 years of experience in a medical or insurance role Required Requirements - Display proficient telephone and computer skills with clear and professional speaking abilities. - Excellent organizational skills. - Excellent communication skills and follow through with internal and external customers. - Knowledge of insurance and medical terminology. - Basic knowledge of current CPT/ICD coding. - Able to provide exceptional customer service by assessing patient needs, meeting quality standards, and evaluating satisfaction. - Capable of being empathetic and responsive to patient’s needs by actively listening, asking appropriate questions, and continually looking for ways to provide assistance. - Able to efficiently multi-task and adapt to fast-paced environments with frequently changing protocols and processes. - Capable of effectively and positively interacting with staff members throughout the company. - Promote teamwork and provide a supportive environment throughout the organization. - Display grammar, spelling, and punctuation knowledge to accurately document patient information. - Able to work independently and think critically using provided information. Physical Demands - Sit - Constantly - Stand - Rarely - Walk - Rarely - Drive - Rarely - Climb (Stairs/Ladders) - Rarely - Bend (Neck) - Frequently - Gross Manipulation (Hands/Arms) - Constantly - Squat - Rarely - Twist/Turn (Neck) - Occasionally - Lift/Carry 0-10 lbs. - Rarely - Lift/Carry 11-25 lbs. - Rarely - Lift/Carry 26-35 lbs. - Rarely - Push/Pull up to 10 lbs. - Rarely - Push/Pull 11-25 lbs. - Rarely - Push/Pull 26-35 lbs. - Rarely - Reach (Above shoulder level) - Rarely - Reach (Below shoulder level) - Constantly - Simple Grasping (Hands/Arms) - Constantly - Fine Manipulation (Hands/Arms) - Constantly - Gross Manipulation (Hands/Arms) - Constantly Working Conditions - Noise - Occasionally Travel Requirements - 5% Hearing Requirements - Hears Whispers < 3 feet - Constantly - Hears Whispers 3-8 feet - Constantly Vision Requirements - Color Discrimination - Constantly - Near Vision (Correctable to Jaeger 2 or 20/40 binocular) - Constantly - Distance Vision (Correctable to Snellen chart 20/40 binocular) - Constantly

United States
Job Closed