Job Closed

This listing is no longer active.

Evaluation Specialist

Location

United States

Posted

54 days ago

Salary

0

Seniority

Mid Level

No structured requirement data.

Job Description

Evaluation Specialist

Kaleidoscope Affect, LLC

Role Description Kaleidoscope Affect is seeking an Evaluation Specialist to support the design and execution of learning measurement and continuous improvement strategies for a large-scale training initiative. This role will help build evaluation plans, pre/post measures, learner and manager feedback tools, reinforcement checks, and dashboards that connect learning outcomes to business and performance indicators. - Design evaluation strategies aligned to Kirkpatrick Levels 1–4 - Develop pre/post assessments, pulse checks, learner surveys, and follow-up tools - Support reporting structures for participation, completion, learning hours, and behavioral indicators - Analyze learner feedback and outcome trends to inform recommendations - Partner with project leadership and learning teams to improve program effectiveness over time - Contribute to quarterly and annual evaluation reporting Qualifications - Bachelor's or master's degree in education, evaluation, organizational development, psychology, public policy, statistics, or related field - 5+ years of experience in training evaluation, learning measurement, survey design, or program analysis - Experience working with qualitative and quantitative feedback methods - Strong writing and analytical skills Requirements - Experience evaluating leadership development, workforce training, or organizational effectiveness programs - Familiarity with dashboards, reporting tools, and learning analytics - Experience in government or public-sector environments

Related Job Pages

More Machine Learning Engineer Jobs

DraftKings Inc. logo

Senior Machine Learning Engineer

DraftKings Inc.

We’re a publicly traded (NASDAQ: DKNG) technology company headquartered in Boston. As a regulated gaming company, you may be required to obtain a gaming license issued by the appropriate state agency as a condition of employment. Don’t worry, we’ll guide you through the process if this is relevant to your role.

Full TimeRemoteTeam 1,001-5,000

At DraftKings, AI is becoming an integral part of both our present and future, powering how work gets done today, guiding smarter decisions, and sparking bold ideas. It’s transforming how we enhance customer experiences, streamline operations, and unlock new possibilities. Our teams are energized by innovation and readily embrace emerging technology. We’re not waiting for the future to arrive. We’re shaping it, one bold step at a time. To those who see AI as a driver of progress, come build the future together. The Crown Is Yours As a Senior Machine Learning Engineer on the Personalization team, you'll shape how players experience our products by building real-time, one-to-one personalization at scale. You'll design and deploy machine learning systems that deepen engagement, improve retention, and drive long-term player value. Working across Engineering, Product, and Analytics teams, you'll turn data into impactful experiences while advancing how we build, deploy, and optimize ML solutions. This role blends hands-on model development with system design and technical leadership in a fast-moving, high-impact environment. What You'll Do - Lead end-to-end machine learning initiatives focused on improving player engagement and retention, from initial concept through production deployment. - Build scalable, reusable machine learning pipelines with a focus on reliability, maintainability, and performance. - Design and manage CI/CD workflows for machine learning using tools like MLflow, Jenkins, and GitOps to enable automated and efficient model deployment. - Monitor model performance in production, implementing retraining strategies, drift detection, and continuous optimization. - Partner with cross-functional teams to translate business goals and user insights into high-impact machine learning solutions. - Mentor other engineers and help define best practices for machine learning system design, development, and deployment. What You'll Bring - Bachelor's degree in Computer Science, Data Science, Statistics, Mathematics, or a related technical field. - At least 3 years of experience working with machine learning systems in production environments. - Strong proficiency in Python and SQL, with experience working on distributed data platforms such as Spark. - Proven experience delivering production-grade machine learning models that drive measurable business impact. - Hands-on experience with Databricks for managing machine learning workflows, model lifecycle, and collaborative development. - Experience designing experiments and analyzing A/B tests to validate and optimize model performance. - Strong communication and collaboration skills, with experience mentoring or leading technical initiatives. Join Our Team We’re a publicly traded (NASDAQ: DKNG) technology company headquartered in Boston. As a regulated gaming company, you may be required to obtain a gaming license issued by the appropriate state agency as a condition of employment. Don’t worry, we’ll guide you through the process if this is relevant to your role. The US base salary range for this full-time position is 134,400.00 USD - 168,000.00 USD, plus bonus, equity, and benefits as applicable. Our ranges are determined by role, level, and location. The compensation information displayed on each job posting reflects the range for new hire pay rates for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific pay range and how that was determined during the hiring process. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

United States
$134K - $168K / year
Job Closed
Full TimeRemoteTeam 11-50Since 2000H1B Sponsor

• Expand ML Capabilities – Identify, prototype, and integrate new ML technologies and infrastructure to enhance fraud detection effectiveness and scalability. • Enable High-Velocity Experimentation – Own the design and implementation of ML pipeline components that accelerate our innovation. • Collaborate Across Functions – Partner with Product, Engineering, and Risk teams to translate business requirements into technical solutions and ensure ML initiatives align with customer needs. • Raise the Bar – Foster a culture of technical excellence by championing best practices in testing, documentation, model monitoring, and development.

Colorado + 2 moreAll locations: Colorado | Illinois | Washington
$150K - $180K / year
Tyto Athene, LLC logo

Machine Learning Engineer

Tyto Athene, LLC

At Tyto Athene, we harness the power of technology to provide solutions that shape the future.

Full TimeRemoteTeam 1,001-5,000Since 2018H1B No Sponsor

• Serve as a subject matter expert in Machine Learning and its applications in Cyber Defense, researching and implementing differentiating and novel ML-based solutions to problems SOCs face • Developing agentic solutions for Cyber Incident Response • Solve complex security and architecture challenges with creativity and precision, with a focus on real-time performance and scalability • Identify and recommend improvements to architectures, especially in secure environments

Virginia
Job Closed
Children’s Hospital of Philadelphia logo

Coord Learning & Development

Children’s Hospital of Philadelphia

At CHOP, we are committed to fair and transparent pay practices. Factors such as skills and experience could result in an offer above the salary range noted in this job posting. Click here for more information regarding CHOP's Compensation and Benefits.

Full TimeRemoteTeam 5,001-10,000

SHIFT: Day (United States of America) Seeking Breakthrough Makers Children’s Hospital of Philadelphia (CHOP) offers countless ways to change lives. Our diverse community of more than 20,000 Breakthrough Makers will inspire you to pursue passions, develop expertise, and drive innovation. At CHOP, your experience is valued; your voice is heard; and your contributions make a difference for patients and families. Join us as we build on our promise to advance pediatric care—and your career. CHOP does not discriminate on the basis of race, color, sex, national origin, religion, or any other legally protected categories in any employment, training, or vendor decisions or programs. CHOP recognizes the critical importance of a workforce rich in varied backgrounds and experiences and engages in ongoing efforts to achieve that through equally varied and non-discriminatory means. A Brief Overview The Coordinator, Learning & Development plays an important role in supporting CHOP's learning and development functions. Key responsibilities include instructor-led classroom and event coordination, virtual session production, marketing activities, vendor coordination, program support and communication, project planning, monitoring, analysis, and reporting. What you will do - Coordinate the creation of, publishing, and marketing of the annual learning calendar. - Be the primary virtual learning session Producer, to include virtual room preparation (set up and clean up), active in-session facilitator support, attendance capture, and pre-and post-session participant support. - Coordinate all aspects of learning events and cohort programs, both onsite and virtual, including facilitator scheduling, nomination and registration management, room scheduling, catering, set-up and breakdown, media preparation and support, attendance tracking, pre- and post-event participant support, metrics development, collection and reporting. - Participate in and support the design, development, and implementation of learning activities, offer the coordination and logistical perspective and impact to various solutions, and support those solutions as appropriate. - Liaise with Learning Management System (LMS) administration for all activities related to LMS, including but not limited to scheduling, Program/Cohort creation and tracking, regular and custom reporting, survey implementation, and analysis of registration and attendance. - Establish and maintain vendor relationships, including tracking of SOWs, invoices, POs, and other documentation. Education Qualifications - High School Diploma / GED Required - Bachelor's Degree Preferred Experience Qualifications - At least three (3) years relevant training coordination and/or event planning experience Required - Experience in Learning Management System administration Required - working in a healthcare environment Preferred - managing vendors Preferred Skills and Abilities - Intermediate to Advanced proficiency in MS Excel, Word, Outlook, and PowerPoint. - Facility with a Learning Management System. - Exceptional customer service skills - Strong analytical skills - Ability to work independently - Demonstrated ability to build relationships with a broad range of people across a large organization to support programs and projects - Strong attention to detail, organizational and time management skills To carry out its mission, CHOP is committed to supporting the health of our patients, families, workforce, and global community. As a condition of employment, CHOP employees who work in patient care buildings or who have patient facing responsibilities must receive an annual influenza vaccine. Learn more. EEO / VEVRAA Federal Contractor | Tobacco Statement SALARY RANGE: $61,360.00 - $78,230.00 Annually Salary ranges are shown for full-time jobs. If you're working part-time, your pay will be adjusted accordingly. ------------------- At CHOP, we are committed to fair and transparent pay practices. Factors such as skills and experience could result in an offer above the salary range noted in this job posting. Click here for more information regarding CHOP's Compensation and Benefits.

United States
$61.4K - $78.2K / year
Job Closed