Workiy Inc. logo
Workiy Inc.

Digital key to work

QA Lead – Agentic AI Platform

QA EngineerQA EngineerContractRemoteSeniorTeam 11-50Since 2008H1B No SponsorCompany SiteLinkedIn

Location

Canada

Posted

1 day ago

Salary

0

Seniority

Senior

EnglishPython

Job Description

QA Lead – Agentic AI Platform

Workiy Inc.

• Drive end-to-end quality assurance for an advanced Agentic AI platform • Define quality standards and develop automated evaluation frameworks • Lead test strategy and ensure release readiness for AI-powered conversational solutions • Build evaluation harnesses and create test plans • Execute regression testing and validate data quality • Conduct AI safety and prompt injection testing • Manage defect triage and lead a team of QA and Data Testers • Collaborate closely with engineering, product, architecture, and data teams to ensure delivery of reliable and high-quality AI solutions

Job Requirements

  • QA Leadership
  • Python
  • Test Automation
  • AI/LLM Testing
  • Conversational AI Testing
  • RAG (Retrieval-Augmented Generation) Testing
  • LLM Evaluation Frameworks
  • Golden Dataset & Regression Testing
  • Intent & Context Validation
  • Multi-Turn Dialogue Testing
  • Data Quality Testing
  • Prompt Injection & AI Safety Testing
  • Release Readiness & Quality Gates
  • Defect Management & Test Strategy
  • CI/CD Integrated Testing
  • Team Leadership & Mentoring

Benefits

  • Flexible working hours

Related Categories

Related Job Pages

More QA Engineer Jobs

OneDome logo

Quality Assurance Engineer

OneDome

Faster, simpler homebuying. Guaranteed.

QA Engineer1 day ago
ContractRemoteTeam 51-200H1B No Sponsor

• Product requirements analysis and gathering • Estimating the required testing time • Control product quality • Communicating with developers, product managers and customer success team • Executing various types of testing activities including functional and regression testing on web projects • Creation QA documentation (test cases/checklists/test summary report)

Ukraine
$1K - $1.5K / year
Hilton Grand Vacations logo

Digital QA Analyst

Hilton Grand Vacations

We offer unique career opportunities in the most sought-after vacation destinations around the world.

QA Engineer1 day ago
Full TimeRemoteTeam 10,001+Since 1992H1B No Sponsor

• Develop and execute comprehensive QA plans for digital marketing campaigns. • Identify and resolve data-related issues, ensuring accurate and reliable information. • Collaborate with the marketing team to understand campaign objectives and requirements. • Perform thorough testing of digital assets, including websites, landing pages, and email campaigns. • Create and maintain test cases, ensuring coverage of all critical aspects of the campaigns. • Analyze test results and provide detailed reports to the team, highlighting areas for improvement. • Work closely with developers to troubleshoot and resolve technical issues. • Stay updated with industry best practices and emerging trends in digital QA. • Ensure compliance with Hilton's brand standards and guidelines in all digital assets. • Provide support and guidance to other team members on QA-related matters.

Florida
Job Closed
Tight Line logo

QA Manager

Tight Line

Excellence in Software Development

QA Engineer1 day ago
Full TimeRemoteTeam 51-200Since 2024H1B No Sponsor

• Oversee functional testing for PulsePoint Platform • Coordinate launch and post-launch QA activities and closely monitor impact of product changes • Define KPIs, track progress, and communicate results to stakeholders with clarity and impact • Document long-term testing strategy and changes required • Assist in the design and evolution of the company’s QA process • Delegate technical tasks among the team members and execute as per the project plan • Contribute as an individual during test design, test planning, and test execution • Identify and communicate risk and risk mitigation strategies • Review test plans, test cases, and scripts to ensure coverage based on requirements • Assure synchronization with other systems occurring for full coverage • Collaborate on and learn new technologies • Work closely with on-site and remote stakeholders in several countries

India
Zensar logo

Functional Tester

Zensar

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus. Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

QA Engineer1 day ago
Full TimeRemoteTeam 10,001

Role Description The Functional Tester will play a crucial role in maintaining and optimizing a critical legacy WMS, working closely with business stakeholders to ensure smooth operations. This role demands a hands-on approach to validate backend data, with no direct vendor support available. The ideal candidate will have a strong background in C++ and Oracle, and be able to collaborate effectively with business users to understand and address their needs. Qualifications - Strong background in C++ - Experience with Oracle - Ability to collaborate effectively with business users Company Description At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. - Part of the $4.8 billion RPG Group - Community of 10,000+ innovators across 30+ global locations - Core values: One Zensar, Nurturing, Empowering, and Client Focus We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace.

India