We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
AI Evaluation Expert
Location
United States
Posted
13 hours ago
Salary
$60 - $75 / hour
Seniority
Senior
Job Description
AI Evaluation Expert
Weekday (YC W21)
• Join an advanced AI research initiative focused on improving how next-generation AI systems understand professional documents, execute complex instructions, and reason through real-world technical workflows. • Create realistic, multi-step evaluation tasks based on technical documentation, code repositories, API references, architecture diagrams, and other workplace resources. • Help measure and improve the ability of AI models to interpret technical information, follow detailed instructions, and generate accurate, well-structured outputs.
Job Requirements
- Minimum 3 years of hands-on professional experience in one or more of the following areas:
- Software Engineering
- Data Science
- Data Analytics
- Strong understanding of technical documentation, software development workflows, and engineering best practices.
- Experience working with codebases, APIs, technical specifications, or system architecture documentation.
- Excellent analytical thinking and problem-solving skills.
- Strong written communication with the ability to create clear technical instructions and evaluation criteria.
- Ability to work independently while maintaining high standards of accuracy and consistency.
Related Guides
Related Categories
Related Job Pages
More Artificial Intelligence Jobs
Voice Actor, Southern American English – AI Speech & Voice Modeling
Weekday (YC W21)We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
• Record high-quality audio across a variety of script types, including conversational, narrative, instructional, and customer interaction scenarios. • Deliver natural, expressive speech with excellent control of tone, pacing, pronunciation, and clarity. • Maintain consistent voice quality, accent, and delivery throughout multiple recording sessions. • Adhere to detailed recording guidelines regarding recording environment, microphone setup, audio quality, and file formatting. • Produce multiple takes with different emotional styles, emphasis, or delivery when requested. • Ensure recordings are clean, free from background noise, and meet project quality standards.
AI Evaluation Specialist
Weekday (YC W21)We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
• Review AI-generated content for accuracy, logical reasoning, completeness, and clarity. • Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions. • Assess responses using structured evaluation frameworks and detailed quality guidelines. • Write clear, concise, and evidence-based rationales explaining evaluation decisions. • Highlight both strengths and areas for improvement in AI-generated outputs. • Apply consistent judgment across a wide range of evaluation tasks. • Follow detailed project instructions and standardized assessment criteria. • Ensure evaluations are objective, accurate, and reproducible. • Complete assignments independently while maintaining high quality standards.
AI-Native Marketing Manager
Human IntelligenceAt Human Intelligence, we're building a future where artificial intelligence helps people better understand themselves, better understand each other, and ultimately create a happier, healthier, and more connected world. We rely on exceptional systems working behind the scenes. We're looking for an exceptional GoHighLevel Automation Specialist to help build, optimize, and continuously improve one of the world's most AI-first CRM ecosystems. Our culture emphasizes strategic systems, friction removal, quality improvement, and intentional customer journeys.
Role Description As our AI-Native Marketing Manager, you'll lead and execute integrated marketing initiatives across multiple products, brands, campaigns, and customer journeys. You'll combine strategic thinking with practical execution while continuously using AI to improve efficiency, creativity, personalization, and marketing performance. This is a hands-on leadership role requiring strong commercial thinking, outstanding communication skills, exceptional organization, and genuine curiosity about emerging technology. Qualifications - 5+ years of professional marketing experience. - Experience managing integrated digital marketing campaigns. - Strong understanding of customer acquisition, conversion optimization, and customer lifecycle marketing. - Experience with email marketing, marketing automation, CRM systems, SEO, and digital analytics. - Excellent written and verbal English communication skills. - Strong analytical and commercial thinking. - Outstanding organizational and project management skills. - Experience managing multiple campaigns simultaneously. - Ability to work independently within a fully remote environment. Requirements - Experience using AI for campaign planning, research, customer insights, copy generation, SEO, analytics, reporting, workflow automation, creative ideation, and marketing optimization. - Experience with ChatGPT and other AI productivity platforms is expected. Benefits - Employment Type: Independent Contractor - Location: Fully Remote - Monthly Base Compensation: USD $1,500–$2,500 per month, depending on your experience, marketing capability, AI proficiency, commercial results, and overall fit. - Performance Incentives: Monthly KPI and performance incentives based on measurable outcomes including marketing-qualified leads (MQLs), revenue contribution, campaign ROI, customer acquisition, conversion rate improvements, product launch success, marketing automation improvements, AI implementation and innovation, and cross-functional contribution. - Compensation reviews conducted following successful completion of the probationary period based on sustained performance, leadership, initiative, and business impact.
Senior Integrative Designer
Human IntelligenceAt Human Intelligence, we're building a future where artificial intelligence helps people better understand themselves, better understand each other, and ultimately create a happier, healthier, and more connected world. We rely on exceptional systems working behind the scenes. We're looking for an exceptional GoHighLevel Automation Specialist to help build, optimize, and continuously improve one of the world's most AI-first CRM ecosystems. Our culture emphasizes strategic systems, friction removal, quality improvement, and intentional customer journeys.
Role Description As our Senior Integrative Designer, you'll own the creative execution of a broad range of business, educational, marketing, and product assets. You'll combine strategic thinking, exceptional visual design, AI-assisted creativity, and outstanding attention to detail to produce consistently high-quality work across multiple brands and initiatives. This is an AI-first role. We're looking for someone who actively embraces modern AI creative tools to increase speed, quality, consistency, and creative exploration while maintaining exceptional design standards. You'll collaborate closely with marketing, leadership, product, operations, copywriters, developers, and automation specialists to bring ideas to life quickly and beautifully. What You'll Be Doing - Brand & Visual Identity: - Design premium visual assets that strengthen the Human Intelligence brand. - Maintain consistency across all digital and physical touchpoints. - Develop visual systems, templates, and reusable design libraries. - Ensure brand consistency across multiple products and initiatives. - Business Resources: - Design presentations and keynote decks. - Business proposals. - White papers. - Guides. - Reports. - Brochures. - Infographics. - Educational resources. - Downloadable PDFs. - Internal documentation. - Executive presentations. - Digital Marketing: - Social media graphics. - Landing pages. - Website visuals. - Advertising creative. - Email marketing assets. - Sales collateral. - Campaign graphics. - Product launches. - Promotional resources. - AI Creative Production: - Leverage AI tools to accelerate creative workflows, including: - Image generation. - Concept exploration. - Graphic enhancement. - Video editing assistance. - Presentation design. - Layout generation. - Creative ideation. - Rapid prototyping. - Asset variations. - Workflow automation. - Cross-Functional Collaboration: - Work closely with Marketing to improve campaign performance. - Support Product with UI assets and product graphics. - Collaborate with Copywriters to create compelling visual storytelling. - Assist Leadership with investor, partner, and executive presentations. - Partner with developers to ensure designs are implemented accurately. - Creative Quality: - Review your own work thoroughly before submission. - Maintain exceptional attention to detail. - Produce polished, production-ready assets. - Continuously improve design systems and creative workflows. - Help establish Human Intelligence as a world-class visual brand. Qualifications - 5+ years of professional graphic design, digital design, or integrated design experience. - A strong portfolio demonstrating premium-quality creative work across multiple mediums. - Advanced proficiency with Adobe Creative Cloud (Photoshop, Illustrator, InDesign and Acrobat). - Experience designing business presentations, reports, brochures, educational resources, and marketing collateral. - Strong typography, layout, hierarchy, and visual communication skills. - Experience designing for both print and digital environments. - Excellent written and spoken English. - Strong attention to detail and quality control. - Ability to manage multiple projects simultaneously. - Experience working within established brand guidelines while contributing to brand evolution. Requirements - Experience with tools such as ChatGPT, Midjourney, Adobe Firefly, Runway, Kling, Veo, Canva AI, Figma AI, Gamma, or similar platforms will be highly regarded. - You don't need to use every tool. What matters is that you genuinely enjoy learning new technologies and continually improving your creative workflow. Benefits - Employment Type: Independent Contractor - Location: Fully Remote - Compensation: USD $1000 - $1500 + performance incentives up to $500/mo - Competitive monthly USD retainer based on experience, capability, portfolio quality, and geographic location, plus performance incentives where applicable.
