Overview As a Principal Product Manager, you will lead the human-in-the-loop evaluation program that drives the quality and experience of M365 Copilot Chat for Business—ensuring M365 Copilot is the best AI assistant for work, grounded in M365 data. You'll build and scale the people, processes, and evaluation pipelines that turn expert human judgment into reliable quality signals that directly shape the product. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. Responsibilities - Define what great looks like for human data—bringing your own knowledge and perspective on the best approaches to collecting, interpreting, and applying human feedback across product decisions. - Lead the human-in-the-loop evaluation program—designing evaluation frameworks, scorecards, and quality benchmarks that measure and continuously raise the bar on M365 Copilot's response quality, helpfulness, and user experience. - Build and manage evaluation workforce operations, including vendor partnerships, annotator onboarding, qualification, training, and continuous performance management. - Partner with data scientists and engineers to scope evaluation needs, define task instructions, calibrate annotators, and ensure evaluation data is reliable and repeatable. Qualifications Required Qualifications: - Bachelor's Degree AND 8+ years experience in product/service/program management or software development - OR equivalent experience. Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Preferred Qualifications: - Bachelor's Degree AND 8+ years experience in product/service/program management or software development - OR equivalent experience. - 3+ years of human data or human-in-the-loop evaluation experience. - Experience at an AI research organization or AI data services provider. - 4+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework). - 6+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn). - Experience building and managing workforce programs, including vendor partnerships and annotation operations at scale. - Proficiency in evaluation pipeline design, annotation frameworks, and quality governance. - Track record of translating human feedback and evaluation signals into measurable product impact. #AI, #Humandata Product Management IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

• Take ownership of a high-impact product or business initiative and drive it from concept through execution • Define and validate new product opportunities • Translate ambiguous problems into clear product strategies • Lead cross-functional development across engineering, data, GTM, and operations • Own product direction, execution, and outcomes • Partner closely with leadership to prioritize and resource new initiatives • Build 0→1 products or scale early-stage bets

• Be accountable for co-creating AI/ML courses on Coursera and the DeepLearning.AI platform through partnerships with world-class AI experts. • Be the authority on the course creation process and guide the Subject Matter Experts (SMEs) and other content development partners through it. • Ensure consistently high content quality by holding the bar for technical content that is accurate, engaging, and effective, and guide and support the team, including the SME in reaching that bar. • Develop an independent perspective on the material being taught so that you can flex to assist the SME in fleshing out the topic and/or assist the content development team in creating relevant learning material if needed. • Quickly learning about the course topics from journal articles and other technical material. • Assessing how the SME’s expertise can best be utilized, and directing the work of other team members to effectively deliver high-quality content in a timely manner. • Reviewing and providing constructive feedback on technical AI content created by the SMEs and others, and determining how it can be converted into a high-quality learning experience through improvements to the words, visuals, code, and overall flow of ideas. • Tracking the creation and external review of all elements of the course, and creating them yourself if need be. • Working closely with a production and visual design team to record videos, add visual design, and deliver high-quality multimedia content to support the curriculum.

• Own the end-to-end strategy, execution, and operational performance of Omada’s GLP-1 and medication-enabled care experiences • Collaborate with senior leadership to define annual and multi-year strategic priorities for medication-supported behavior change • Be accountable for business performance, clinical outcomes, member experience, and operational scalability within your domain • Champion bold, organization-wide changes required to compete in a rapidly evolving GLP-1 market • Build durable cross-functional operating models across Product, Clinical, Engineering, Care Delivery, Member Support, Legal, and Commercial teams • Establish scalable mechanisms for performance tracking, experimentation governance, and decision-making rigor • Represent the product strategy in executive forums and, when appropriate, with key buyers, partners, or industry stakeholders • Cultivate an innovative environment that challenges your cross-functional peers to think in new ways