Weekday (YC W21) logo
Weekday (YC W21)

We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

AI Evaluation Expert

Artificial IntelligenceArtificial IntelligenceContractRemoteSeniorTeam 11-50Since 2021H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

13 hours ago

Salary

$60 - $75 / hour

Seniority

Senior

3 yrs expEnglish

Job Description

AI Evaluation Expert

Weekday (YC W21)

• Join an advanced AI research initiative focused on improving how next-generation AI systems understand professional documents, execute complex instructions, and reason through real-world technical workflows. • Create realistic, multi-step evaluation tasks based on technical documentation, code repositories, API references, architecture diagrams, and other workplace resources. • Help measure and improve the ability of AI models to interpret technical information, follow detailed instructions, and generate accurate, well-structured outputs.

Job Requirements

  • Minimum 3 years of hands-on professional experience in one or more of the following areas:
  • Software Engineering
  • Data Science
  • Data Analytics
  • Strong understanding of technical documentation, software development workflows, and engineering best practices.
  • Experience working with codebases, APIs, technical specifications, or system architecture documentation.
  • Excellent analytical thinking and problem-solving skills.
  • Strong written communication with the ability to create clear technical instructions and evaluation criteria.
  • Ability to work independently while maintaining high standards of accuracy and consistency.

Related Job Pages

More Artificial Intelligence Jobs

Weekday (YC W21) logo

Voice Actor, Southern American English – AI Speech & Voice Modeling

Weekday (YC W21)

We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

Part TimeRemoteTeam 11-50Since 2021H1B No Sponsor

• Record high-quality audio across a variety of script types, including conversational, narrative, instructional, and customer interaction scenarios. • Deliver natural, expressive speech with excellent control of tone, pacing, pronunciation, and clarity. • Maintain consistent voice quality, accent, and delivery throughout multiple recording sessions. • Adhere to detailed recording guidelines regarding recording environment, microphone setup, audio quality, and file formatting. • Produce multiple takes with different emotional styles, emphasis, or delivery when requested. • Ensure recordings are clean, free from background noise, and meet project quality standards.

Alabama + 6 moreAll locations: Alabama | Louisiana | North Carolina | Mississippi | South Carolina | Tennessee | Texas
$50 / hour
Weekday (YC W21) logo

AI Evaluation Specialist

Weekday (YC W21)

We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

ContractRemoteTeam 11-50Since 2021H1B No Sponsor

• Review AI-generated content for accuracy, logical reasoning, completeness, and clarity. • Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions. • Assess responses using structured evaluation frameworks and detailed quality guidelines. • Write clear, concise, and evidence-based rationales explaining evaluation decisions. • Highlight both strengths and areas for improvement in AI-generated outputs. • Apply consistent judgment across a wide range of evaluation tasks. • Follow detailed project instructions and standardized assessment criteria. • Ensure evaluations are objective, accurate, and reproducible. • Complete assignments independently while maintaining high quality standards.

United States
$70 / hour
Human Intelligence logo

AI-Native Marketing Manager

Human Intelligence

At Human Intelligence, we're building a future where artificial intelligence helps people better understand themselves, better understand each other, and ultimately create a happier, healthier, and more connected world. We rely on exceptional systems working behind the scenes. We're looking for an exceptional GoHighLevel Automation Specialist to help build, optimize, and continuously improve one of the world's most AI-first CRM ecosystems. Our culture emphasizes strategic systems, friction removal, quality improvement, and intentional customer journeys.

Role Description As our AI-Native Marketing Manager, you'll lead and execute integrated marketing initiatives across multiple products, brands, campaigns, and customer journeys. You'll combine strategic thinking with practical execution while continuously using AI to improve efficiency, creativity, personalization, and marketing performance. This is a hands-on leadership role requiring strong commercial thinking, outstanding communication skills, exceptional organization, and genuine curiosity about emerging technology. Qualifications - 5+ years of professional marketing experience. - Experience managing integrated digital marketing campaigns. - Strong understanding of customer acquisition, conversion optimization, and customer lifecycle marketing. - Experience with email marketing, marketing automation, CRM systems, SEO, and digital analytics. - Excellent written and verbal English communication skills. - Strong analytical and commercial thinking. - Outstanding organizational and project management skills. - Experience managing multiple campaigns simultaneously. - Ability to work independently within a fully remote environment. Requirements - Experience using AI for campaign planning, research, customer insights, copy generation, SEO, analytics, reporting, workflow automation, creative ideation, and marketing optimization. - Experience with ChatGPT and other AI productivity platforms is expected. Benefits - Employment Type: Independent Contractor - Location: Fully Remote - Monthly Base Compensation: USD $1,500–$2,500 per month, depending on your experience, marketing capability, AI proficiency, commercial results, and overall fit. - Performance Incentives: Monthly KPI and performance incentives based on measurable outcomes including marketing-qualified leads (MQLs), revenue contribution, campaign ROI, customer acquisition, conversion rate improvements, product launch success, marketing automation improvements, AI implementation and innovation, and cross-functional contribution. - Compensation reviews conducted following successful completion of the probationary period based on sustained performance, leadership, initiative, and business impact.

Worldwide
$1.5K - $2.5K / month
Human Intelligence logo

Senior Integrative Designer

Human Intelligence

At Human Intelligence, we're building a future where artificial intelligence helps people better understand themselves, better understand each other, and ultimately create a happier, healthier, and more connected world. We rely on exceptional systems working behind the scenes. We're looking for an exceptional GoHighLevel Automation Specialist to help build, optimize, and continuously improve one of the world's most AI-first CRM ecosystems. Our culture emphasizes strategic systems, friction removal, quality improvement, and intentional customer journeys.

Role Description As our Senior Integrative Designer, you'll own the creative execution of a broad range of business, educational, marketing, and product assets. You'll combine strategic thinking, exceptional visual design, AI-assisted creativity, and outstanding attention to detail to produce consistently high-quality work across multiple brands and initiatives. This is an AI-first role. We're looking for someone who actively embraces modern AI creative tools to increase speed, quality, consistency, and creative exploration while maintaining exceptional design standards. You'll collaborate closely with marketing, leadership, product, operations, copywriters, developers, and automation specialists to bring ideas to life quickly and beautifully. What You'll Be Doing - Brand & Visual Identity: - Design premium visual assets that strengthen the Human Intelligence brand. - Maintain consistency across all digital and physical touchpoints. - Develop visual systems, templates, and reusable design libraries. - Ensure brand consistency across multiple products and initiatives. - Business Resources: - Design presentations and keynote decks. - Business proposals. - White papers. - Guides. - Reports. - Brochures. - Infographics. - Educational resources. - Downloadable PDFs. - Internal documentation. - Executive presentations. - Digital Marketing: - Social media graphics. - Landing pages. - Website visuals. - Advertising creative. - Email marketing assets. - Sales collateral. - Campaign graphics. - Product launches. - Promotional resources. - AI Creative Production: - Leverage AI tools to accelerate creative workflows, including: - Image generation. - Concept exploration. - Graphic enhancement. - Video editing assistance. - Presentation design. - Layout generation. - Creative ideation. - Rapid prototyping. - Asset variations. - Workflow automation. - Cross-Functional Collaboration: - Work closely with Marketing to improve campaign performance. - Support Product with UI assets and product graphics. - Collaborate with Copywriters to create compelling visual storytelling. - Assist Leadership with investor, partner, and executive presentations. - Partner with developers to ensure designs are implemented accurately. - Creative Quality: - Review your own work thoroughly before submission. - Maintain exceptional attention to detail. - Produce polished, production-ready assets. - Continuously improve design systems and creative workflows. - Help establish Human Intelligence as a world-class visual brand. Qualifications - 5+ years of professional graphic design, digital design, or integrated design experience. - A strong portfolio demonstrating premium-quality creative work across multiple mediums. - Advanced proficiency with Adobe Creative Cloud (Photoshop, Illustrator, InDesign and Acrobat). - Experience designing business presentations, reports, brochures, educational resources, and marketing collateral. - Strong typography, layout, hierarchy, and visual communication skills. - Experience designing for both print and digital environments. - Excellent written and spoken English. - Strong attention to detail and quality control. - Ability to manage multiple projects simultaneously. - Experience working within established brand guidelines while contributing to brand evolution. Requirements - Experience with tools such as ChatGPT, Midjourney, Adobe Firefly, Runway, Kling, Veo, Canva AI, Figma AI, Gamma, or similar platforms will be highly regarded. - You don't need to use every tool. What matters is that you genuinely enjoy learning new technologies and continually improving your creative workflow. Benefits - Employment Type: Independent Contractor - Location: Fully Remote - Compensation: USD $1000 - $1500 + performance incentives up to $500/mo - Competitive monthly USD retainer based on experience, capability, portfolio quality, and geographic location, plus performance incentives where applicable.

Worldwide
$1K - $2K / month