• Create and curate an evaluation suite. Find real-world tasks that serve as challenging tests for practical AI capabilities, and update the tasks over time as AI capabilities evolve. Devise rubrics for evaluating AI performance. - Evaluate AI systems. Regularly evaluate new, notable AI models and products on the task suite. Update tasks and rubrics to reflect the changing landscape of AI capabilities. - Communicate your research. Create public-facing reports, blog posts, and data visualizations with your observations. Ensure the evaluations feed into our other research topics and help keep our team informed. - Conduct data analysis. Analyze evaluation results and compare models across tasks. - Improve the process. You might automate parts of the workflow, and build out parts of the evaluation into standalone benchmarks.

• Transform raw institutional data from various campus systems into actionable reports and interactive dashboards. • Support federal and state compliance reporting (including IPEDS, institutional and program accreditations, and NYSED). • Oversee internal retention tracking, and provide data-driven insights to advance student success and institutional outcomes. • Assist in the governance, validation, and auditing of data inputs and outputs within enterprise systems (e.g., Slate CRM, Colleague ERP). • Provide regular data reports to support the operation of the College’s academic enterprise (e.g., academic standing, course outcomes). • Support the AVP for Institutional Effectiveness in the design, administration, analysis, and dissemination of institutional surveys.

• support zoning due diligence projects focused on commercial real estate transactions • conducting comprehensive research of property details, zoning classifications, and municipal ordinances • sending Freedom of Information Act (FOIA) requests to municipal jurisdictions throughout the country • collaborate with the Zoning Project Managers to provide accurate, timely information that informs critical site analysis • research property information available from assessor websites & publicly available GIS Maps • FOIA (Freedom of Information Act) submission to Local/County/State Agencies • request and obtain copies of municipal documents such as site plans, surveys, variances and conditional/special use permits • collaborate with Zoning Project Managers to ensure correct property details • coordinate with municipal departments to obtain information regarding outstanding code violations on file for the Subject Property • coordinate payments for copies of the aforementioned municipal documents/information requested via FOIA process • manage & track a list of follow-up tasks to ensure that all requested information/documents are received from the municipalities • stay current with industry best practices for property research • maintain comprehensive databases of municipal contacts

• Build and maintain systems for tracking ideas through development • Identify researchers and institutions we should know, build relationships with them, and keep the team informed about new opportunities • Find the right people and places for each story — and handle the outreach needed to make access happen • Stay across the latest research and discoveries — and flag developments that could become great Veritasium stories • Spot new stories, write pitches and present ideas to the team