Overview AI evaluations are at a critical inflection point. Static benchmarks are saturated; benchmarks like MMLU, HumanEval, and SWE-Bench have reached their limits as models become increasingly familiar with public test data, and capable of autonomously finding answer keys online. The gap between benchmark scores and real developer experience is growing, making it hard to understand which problems are truly ‘solved’, and which are worth deeper investment. GitHub is uniquely positioned to lead the industry through this transition. We have direct feedback and deep insight into real production workflows from millions of developers, and the scale to build evaluation systems that truly reflect developer success. We’re looking for a Principal Technical Program Manager to help us build the future of AI evaluation. The Applied Science team for GitHub Copilot sits at the intersection of frontier AI research and the world's largest developer platform. We ship AI-powered experiences (ex: code completion, code review, coding agents) used by millions of professional developers every day. As a member of the team, you will help lead GitHub Copilot's AI evaluation strategy end-to-end — from benchmark design and lifecycle governance, through evaluation infrastructure and internal adoption, to community engagement and public transparency. You are the person who ensures that every model swap, product harness, and feature launch is measured against what actually matters to developers — and that the world can see the results. Responsibilities In this role you’ll: - Partner with Applied Science researchers to translate cutting-edge evaluation research into production systems: adaptive testing (IRT), agent-centric co-evolution, adversarial benchmarking, and telemetry-driven benchmark generation. - Lead the deprecation of saturated benchmarks and design their next-generation replacements — including procedurally-generated code evaluations that can't be memorized and adaptive testing systems that skip trivial questions for frontier models. - Build GitHub's community benchmark submission program — enabling external researchers, enterprises, and open-source developers to contribute domain-specific evaluations — and publish GitHub's first external benchmark transparency reports showing how models perform on real developer workflows. - Design and operationalize multi-tier evaluation frameworks — from fast automated regression suites and LLM-as-judge systems, through expert human evaluation, to production A/B testing — so teams can iterate in hours, not weeks. - Design feedback-to-benchmark pipelines that convert thumbs-down signals, user frustrations, and support tickets into candidate regression tests — systematizing informal practices into scalable, automated systems. - Establish evaluation as a first-class discipline across GitHub Copilot — creating the rituals, dashboards, and communication cadences that make evaluation results accessible and actionable for every team. Qualifications Required Qualifications - Bachelor's Degree AND 6+ years experience in engineering, product/technical program management, data analysis, or product development OR equivalent experience. - 3+ years of experience managing cross-functional and/or cross-team projects. Other Requirements Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: - Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years Preferred Qualifications - 5+ years of experience in technical program management, product management, applied science, or equivalent - 2+ years managing programs in machine learning, AI/ML evaluation, or data science - 2+ years managing cross-functional and/or cross-team projects - Deep, firsthand experience with AI/ML evaluation methodologies: benchmark design and validity, human evaluation frameworks, automated scoring systems (including LLM-as-judge), A/B testing, and statistical significance. - Deep personal experience with AI coding tools — you use Copilot, Cursor, Claude Code, or similar tools daily and have strong opinions about what "good" looks like from a developer's perspective. - Understanding of software engineering workflows at scale — code review, CI/CD, testing, debugging, refactoring — and how AI tools should integrate into each. - Experience with community or open-source program management — contributor programs, external research partnerships, or developer relations in a technical context. - Proven ability to navigate competing priorities across teams and build shared commitment to common goals in ambiguous, fast-moving environments. - Track record of building evaluation systems that directly influenced product or model shipping decisions at scale. Technical Program Management IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

This position includes a $1,500 Signing Bonus. $3,000 Relocation Bonus available. Note: Internal candidates do not qualify for the bonus. This position is based out of your home office in Maine and requires significant travel, with 50% of your time spent in the community providing in-home and local support to families. Candidates must be able to serve clients in the listed Maine counties: Androscoggin, Franklin, and Oxford. Rooted in our Christian faith, Bethany Christian Services works to ensure children are safe, loved, and connected through family. Across 29 states, we strengthen families, support foster care and adoption, and walk alongside refugees with compassion. Here, living out your faith means using your gifts to bring hope and make a lasting impact. As a Family Preservation Worker, you’ll support families at risk of separation due to challenges like neglect, substance use, or conflict. Through the Homebuilders model, you’ll provide intensive, in-home services that help families stay together, build on their strengths, and keep children safely at home. How Your Role Makes a Difference - Conduct interventions that are consistent with HOMEBUILDERS standards; - Conduct data collection, and reporting in a thorough and timely manner; - Provide client-interactive, comprehensive, strength and behavior-focused assessments; - Work collaboratively with family members and referents in developing intervention goals and service plans directly related to the risk of out-of-home placement, while monitoring the progress, analyze barriers to goal achievement, and help families revise goals or plans as needed; - Serve as a client and family advocate, while also providing concrete goods and services such as transportation as it relates to the family's goals and teach them how to meet these needs on their own; - Serve as a back-up and support other specialists, as needed; - Comply with service definition and guidelines outlined in the HOMEBUILDERS standards for services; - Assess the safety and structure of the home environment and use intervention strategies that promote safety; - Maintain clear and concise documentation of treatment efforts; - Available to clients 24 hours a day and 7 days a week, while also arranging the appropriate coverage, when needed; - Keep up-to-date and accurate client progress notes for all activities and submit reports in a timely manner in accordance with contract requirement, agency expectations, and program policy; - Effectively utilize appropriate systems for data gathering, submission, and tracking client services rendered in accordance with time-bound expectations based on contract requirements, agency expectations, and program policy; - Conduct sessions with families as outlined in the HOMEBUILDERS standards; - Work collaboratively with direct supervisor to implement quality enhancement or quality improvements plans; - Establish and maintain referral and community resources; - Facilitate flexible appointment times outside of regular business hours, and work nontraditional hours in the community, as needed; - Attend weekly meetings with supervisor to review case plan and direction, and to evaluate client participation and progress; - Attend weekly group consultation with HOMEBUILDERS team to consult on cases; - Keep abreast of community resources and refer families for support, as needed; - Stay abreast of all agency, federal, and state regulatory requirements related to social services; - Stay up-to-date on intervention and teaching modalities and complete trainings as required by funding sources, by attending conferences, seminars and journal reading; - Essential job responsibilities may vary based on the specific needs of each program/department; - May be required or asked to participate in a Bethany sponsored event; - Complete other duties as assigned. What Will Make You Successful - Bachelor's degree in Social Work, Social Sciences, Human Services, or related field of study from an accredited college with at least two (2) years of experience working with children and families or a Master's degree in Social Work, Human Services, or related field of study from an accredited college with experience working with children and families; - Demonstrated experience working with children and families from diverse cultures with sensitivity to cultural differences and norms; - Demonstrated ability with providing excellent teaching and crisis intervention skills; - Knowledge of state, community and agency resources; - Excellent verbal and written communication skills; - Capacity to engage, respect, and serve a wide range of clients with a nonjudgmental attitude, while empowering the clients served; - Must have an ability to provide excellent and compassionate customer service; - Ability to work independently and exercise a high level of confidentiality; - Must be willing and able to work outside of normal business hours to include some evenings, weekends, and holidays to address client issues as they arise; - Must live within sixty minutes of proximity to most families being served; - Computer skills sufficient to perform essential functions including knowledge of Microsoft Office Suite; - Must be 21 years old with a valid driver's license with at least 3 years driving experience in the U.S. to operate a vehicle on behalf of Bethany; - Must pass a Motor Vehicle Records (MVR) check and maintain a reliable vehicle with proof of adequate coverage; - Pass a criminal history screen, including state and local child protection agency registries; - Subscription to and integration of the agency Statement of Faith, Mission Statement, and Commitment to Unity. We Invest in You - Experience a team environment with other professionals who are motivated by faith, support one another, pursue excellence, and are in it for the long haul - Access to training, professional development, and career growth opportunities  - Comprehensive health insurance (medical, dental, and vision) - 403(b) retirement plan with employer match eligibility - Generous time off (11 paid holidays, PTO Your Way, paid parental leave, separate sick and paid absence banks) - Access to education reimbursement for those that qualify - Comprehensive employee assistance and wellness program - Employer paid long-term disability and group term life insurance  #LI-CC1 #LI-Remote

Program Grants Coordinator (Maine, Massachusetts, Vermont REMOTE) Location: Maine, Massachusetts, or Vermont Full-time Remote Job Description: PROGRAM GRANTS COORDINATOR You are required to live in Maine, Massachusetts or Vermont to be considered for this role. Provides structured coordination and operational support for complex state or federally funded health initiatives. Supports PMO-led program execution by maintaining integrated schedules, tracking action items, and reinforcing documentation and reporting workflows across workstreams. Maintains structured trackers for milestones, deliverables, procurement activities, subrecipient documentation, and reporting deadlines. Organizes and maintains contract files, grant documentation, and compliance records to support audit-ready program implementation. Coordinates recurring meeting cadences, prepares agendas and briefing materials, documents decisions and action items, and tracks follow-up across internal teams and external partners. Supports technical assistance (TA) activities by coordinating onboarding sessions, maintaining TA request logs, organizing materials, and tracking follow-up actions. Assists with reporting preparation, documentation reconciliation, and task sequencing during high-volume implementation periods. Contributes to disciplined program governance in compliance-driven environments requiring strong organization, attention to detail, and the ability to manage multiple concurrent priorities. Up to 25% travel may be required. Basic Qualifications: - High school diploma required; Associate's or Bachelor's degree in public health, public administration, business administration, health policy, or related field preferred. - Minimum 3 years of experience providing project coordination, program support, or grants administration support within public-sector, healthcare, or grant-funded environments. - Experience supporting state or federally funded programs preferred. - Experience maintaining structured documentation, trackers, and reporting workflows in compliance-driven settings. - Experience coordinating meetings, maintaining action logs, and supporting cross-functional teams in complex implementation environments. - Experience supporting training, onboarding, or technical assistance coordination within public-sector or healthcare programs preferred. - Strong organizational skills and attention to detail, with the ability to manage multiple deadlines in fast-paced, multi-workstream environments. Working at ICF ICF is a global advisory and technology services provider, but we're not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future. We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy. We will consider for employment qualified applicants with arrest and conviction records. Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email Candidateaccommodation@icf.com and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act. Candidate AI Usage Policy At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate or assist with responses during interviews (whether in-person or virtual) is not permitted. This policy is in place to maintain the integrity and authenticity of the interview process. However, we understand that some candidates may require accommodation that involves the use of AI. If such an accommodation is needed, candidates are instructed to contact us in advance at candidateaccommodation@icf.com. We are dedicated to providing the necessary support to ensure that all candidates have an equal opportunity to succeed. Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position. The pay range for this position based on full-time employment is: $61,232.00 - $104,094.00 Nationwide Remote Office (US99)

The application window is expected to close on: 04/22/2026Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received. Meet the Team We are looking for a seasoned, detail-oriented security professional to join our Unified Incident Command (UIC) team. UIC ensures a coordinated, clear, and effective response across Cisco Security & Trust (S&TO) incident teams when handling key security incidents. The core purpose of Unified Incident Command is to drive consistency, collaboration, decisiveness, and speed in incident response efforts. Our team is distributed around the globe, and delivers strategic oversight and coordination for high-impact security incidents, assurance and control to mitigate unnecessary escalation, informed decision making, and accurate, timely, and unbiased communication. The Security Incident Manager is a senior role responsible for managing, documenting and communicating with key team members for enterprise-level security incidents. The Security Incident Manager will act as a key liaison among Cisco’s S&TO investigations teams, as well as cross-functional partner teams such as: Engineering, Legal, Communications, Product Management, and IT. This individual will drive teams to ensure timely detection, containment, mitigation, and communication regarding threats, vulnerabilities and attacks, while minimizing operational disruptions. This role can be performed anywhere in the United States. Your Impact Incident Response Leadership: - Lead and ensure alignment across the working teams responsible for all phases of incident response, including detection, containment, analysis, mitigation, recovery and communication. - Drive decision making and implementation of action plans to manage incidents, coordinating efforts across technical and business teams, as well as leaders and trusted subject matter experts. - Identify gaps that are delaying decision-making and assign owners or call out to leadership to close such gaps. - Ensure alignment to the organization's incident response frameworks, playbooks, and regulatory requirements. Strategic Communication: - Capture/document all facts, decisions, action items, partner team involvement, investigation progress, and core communication in the case management system, and ensure evidence materials are archived. - Provide detailed, actionable reports during and after incidents, including root cause analysis and mitigation strategies. - Serve as the main point of contact for incident updates to executive leadership and internal team members. And partner with external-facing stakeholders to ensure messaging is clear and consistent. Collaboration and Coordination: - Collaborate with S&TO incident teams (such as CSIRT, PSIRT, DCI), as well as Legal, IT, Engineering, Risk Management, Privacy and other organizations to ensure a unified response. - Engage with customer-facing teams, third-party vendors, and customers when necessary. Preparation and Readiness: - Update and refine UIC documentation and processes to further define, streamline, and improve security incident response efforts, and ensure thoroughness/clarity of case documentation. - Develop, maintain, and test incident response plans, playbooks, and escalation procedures. - Conduct and support tabletop exercises and simulations to train and prepare teams. Post-Incident Activities: - Drive post-mortem sessions, capture and share key findings, and clearly assign ownership for long-term fixes / preventative measures identified during the sessions. Compliance and Reporting: - Support Cisco's effort to ensure compliance with regulations, certification obligations, and organizational policies during incident response. - Stay informed about emerging threats and trends in cybersecurity to improve response capabilities. Minimum Qualifications - Bachelor’s degree. - 3+ years of experience of security-related work in the Technology/IT Industry. - Demonstrated experience managing incidents or crisis response, or leading multi-functional teams to deliver large-scale projects. - Excellent written and verbal communication abilities in English. - Experience engaging with senior-level security executives. Preferred Qualifications - Exceptional leadership skills, and the ability to make decisions under pressure. - An ability to learn and apply new information quickly. - Strong critical thinking, analytical, and problem-solving skills. - A team-oriented, collaborative mentality, with the ability to coordinate/delegate an occasional 24 x 7 workload across geographic participants. - Strong understanding of regulatory requirements and industry certifications and standards (e.g., CSL, DSL, PIPL, GDPR, HIPAA, FedRAMP, ISO, PCI-DSS). - Certifications such as GIAC Certified Incident Handler (GCIH), CISSP, CISM, Security+, or Certified Information Systems Auditor (CISA). Work Environment - Remote work environment with some occasional on-site presence required as needed. - On-call rotation availability to respond to critical incidents. - Alternate work hours and job responsibilities may be required as the team manages 24x7x365 cybersecurity incidents within a global operations team. Why Cisco? At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you. Message to applicants applying to work in the U.S. and/or Canada: The starting salary range posted for this position is $130,600.00 to $182,200.00 and reflects the projected salary range for new hires in this position in U.S. and/or Canada locations, not including incentive compensation*, equity, or benefits. Individual pay is determined by the candidate's hiring location, market conditions, job-related skillset, experience, qualifications, education, certifications, and/or training. The full salary range for certain locations is listed below. For locations not listed below, the recruiter can share more details about compensation for the role in your location during the hiring process. U.S. employees are offered benefits, subject to Cisco’s plan eligibility rules, which include medical, dental and vision insurance, a 401(k) plan with a Cisco matching contribution, paid parental leave, short and long-term disability coverage, and basic life insurance. Please see the Cisco careers site to discover more benefits and perks. Employees may be eligible to receive grants of Cisco restricted stock units, which vest following continued employment with Cisco for defined periods of time. U.S. employees are eligible for paid time away as described below, subject to Cisco’s policies: - 10 paid holidays per full calendar year, plus 1 floating holiday for non-exempt employees - 1 paid day off for employee’s birthday, paid year-end holiday shutdown, and 4 paid days off for personal wellness determined by Cisco - Non-exempt employees** receive 16 days of paid vacation time per full calendar year, accrued at rate of 4.92 hours per pay period for full-time employees - Exempt employees participate in Cisco’s flexible vacation time off program, which has no defined limit on how much vacation time eligible employees may use (subject to availability and some business limitations) - 80 hours of sick time off provided on hire date and each January 1st thereafter, and up to 80 hours of unused sick time carried forward from one calendar year to the next - Additional paid time away may be requested to deal with critical or emergency issues for family members - Optional 10 paid days per full calendar year to volunteer For non-sales roles, employees are also eligible to earn annual bonuses subject to Cisco’s policies. Employees on sales plans earn performance-based incentive pay on top of their base salary, which is split between quota and non-quota components, subject to the applicable Cisco plan. For quota-based incentive pay, Cisco typically pays as follows: - .75% of incentive target for each 1% of revenue attainment up to 50% of quota; - 1.5% of incentive target for each 1% of attainment between 50% and 75%; - 1% of incentive target for each 1% of attainment between 75% and 100%; and - Once performance exceeds 100% attainment, incentive rates are at or above 1% for each 1% of attainment with no cap on incentive compensation. For non-quota-based sales performance elements such as strategic sales objectives, Cisco may pay 0% up to 125% of target. Cisco sales plans do not have a minimum threshold of performance for sales incentive compensation to be paid. The applicable full salary ranges for this position, by specific state, are listed below: New York City Metro Area: $152,400.00 - $255,100.00 Non-Metro New York state & Washington state: $134,300.00 - $224,800.00 * For quota-based sales roles on Cisco’s sales plan, the ranges provided in this posting include base pay and sales target incentive compensation combined. ** Employees in Illinois, whether exempt or non-exempt, will participate in a unique time off program to meet local requirements.