• Create realistic prompts based on common small business situations and goals • Interact with multiple AI chatbots and compare response quality • Evaluate outputs based on accuracy, clarity, usefulness, and business relevance • Review AI-generated visual and written business content • Assess workflows involving spreadsheets, PDFs, images, and business documents • Provide structured comparative feedback and scoring • Submit completed evaluation reports and conversation transcripts • Test AI handling of customer communication and operational scenarios • Contribute business insights related to marketing, research, and financial planning • Follow detailed evaluation guidelines and quality standards

• Create realistic prompts based on common small business situations and goals • Interact with multiple AI chatbots and compare response quality • Evaluate outputs based on accuracy, clarity, usefulness, and business relevance • Review AI-generated visual and written business content • Assess workflows involving spreadsheets, PDFs, images, and business documents • Provide structured comparative feedback and scoring • Submit completed evaluation reports and conversation transcripts • Test AI handling of customer communication and operational scenarios • Contribute business insights related to marketing, research, and financial planning • Follow detailed evaluation guidelines and quality standards

• Create realistic prompts based on common small business situations and goals • Interact with multiple AI chatbots and compare response quality • Evaluate outputs based on **accuracy**, **clarity**, **usefulness**, and business relevance • Review AI-generated visual and written business content • Assess workflows involving spreadsheets, PDFs, images, and business documents • Provide structured comparative feedback and scoring • Submit completed evaluation reports and conversation transcripts • Test AI handling of customer communication and operational scenarios • Contribute business insights related to marketing, research, and financial planning • Follow detailed evaluation guidelines and quality standards

Title: Director Engineering - Artificial Intelligence Location: Remote, United States Department: Engineering/IT Job Description: Overview The Director of Engineering AI will drive our AI Platform design across all lines of business. The Director will be responsible for the development and execution of the AI platform and machine learning applications that will empower Cotiviti's Product Groups to deliver innovative AI-powered experiences to our customers. Responsibilities - Driven with sense of urgency and vision for AI, Advanced Statistics, LLM/VectorDB design across all lines of business. - Enthusiastic and have advanced knowledge and know-how of latest and greatest in AI. - Build machine learning foundation and deliver AI/ML projects through the entire development lifecycle. - Extract and transform business requirements into trackable requirements, success criteria, and deliver large-scale machine learning models/services into production. - Work with product and infrastructure teams on how applied machine learning can make their product or system better. - Grow and expand expertise and team with an eye toward diverse and forward-looking skills that span advanced statistics, AI/Machine Learning/Deep Learning, Probabilistic and Generative AI. - Ability to define and connect the product end to end, enabling conceptualization, development and production. - Represent Cotiviti at academic and industrial conferences & events. - Hire, develop, coach, lead and retain top-tier talent, with a focus on building and improving a team and culture that is able to assist in employing best in class practices to support and drive high levels of internal and external customer satisfaction. - Complete all responsibilities as outlined in the annual performance review and/or goal setting. - Complete all special projects and other duties as assigned. - Just be able to perform duties with or without reasonable accommodation. This job description is intended to describe the general nature and level of work being performed and is not to be construed as an exhaustive list of responsibilities, duties, and skills required. This job description does not constitute an employment agreement and is subject to change as the needs of Cotiviti and the requirements of the job change. Qualifications - MS or Ph.D. in quantitative domain (CS + Computational Physics/Math’s). - 10+ years of machine learning and data science experience in high velocity, high-growth companies. - 5+ years of management experience hiring and developing AI/ML teams. - An innovative background with patents and publications in Tier1/2 journals and conferences. - Experience with large-language models (LLMs) a big plus. - Experience building and leading expert machine learning teams that have routinely launched new products and features, driving significant revenue. Comprehensive technical background, spanning multiple areas including software/systems engineering, machine learning, and computational physics/math with GPU based systems. - Experience developing machine learning products and capabilities in a cloud environment. - Strong communication skills to explain and evangelize machine learning to executives and the senior management team. - Bias to action and passion for delivering high-quality data solutions. Mental Requirements: - Enthusiastic and driven with a sense of urgency and vision for AI, Advanced Statistics, LLM/VectorDB design. - Strong communication skills to explain and evangelize machine learning to executives and the senior management team. - Bias to action and passion for delivering high-quality data solutions. - Strong strategic thinking and problem-solving capabilities, with a focus on delivering high-impact, high-quality solutions. Working Conditions and Physical Requirements: - Remaining in a stationary position, often standing or sitting for prolonged periods. - Repeating motions that may include the wrists, hands, and/or fingers. - Must be able to provide a dedicated, secure work area. - Must be able to provide high-speed internet access/connectivity and office setup and maintenance. - Occasional travel for conferences and events required (up to 10%). Base compensation ranges from $200,000 to $240,000 per year. Specific offers are determined by various factors, such as experience, education, skills, certifications, and other business needs. This role is eligible for discretionary bonus consideration. Cotiviti offers team members a competitive benefits package to address a wide range of personal and family needs, including medical, dental, vision, disability, and life insurance coverage, 401(k) savings plans, paid family leave, 9 paid holidays per year, and 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with Cotiviti. For information about our benefits package, please refer to our Careers page. Since this job will be based remotely, all interviews will be conducted virtually. #LI-Remote #