Job Closed
This listing is no longer active.
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia.
AI Testing Architect
Location
United States
Posted
14 days ago
Salary
$50 - $100 / hour
Seniority
Mid Level
No structured requirement data.
Job Description
AI Testing Architect
TEKsystems
Role Description - Define the AI vision and architecture for the testing function. - Identify testing activities that can be improved with AI, including: - Test case generation - Test data creation - Automated test maintenance - Defect prediction - Root cause analysis - Log and failure analysis - Requirements-to-test traceability - Risk-based test prioritization - Intelligent regression selection - Design and implement AI-enabled frameworks for: - Functional testing - API testing - UI automation - Performance testing - Security testing support - Exploratory testing augmentation - Partner with QA, developers, DevOps, product managers, and data teams to embed AI into CI/CD and quality engineering workflows. - Evaluate and recommend AI/ML, GenAI, and test automation tools. - Establish standards for AI governance, privacy, security, explainability, and responsible usage in testing. - Create architecture for integrating LLMs, test repositories, defect systems, observability tools, and CI platforms. - Define metrics to measure the effectiveness of AI in testing, such as: - Defect leakage - Automation coverage - Test execution efficiency - Flaky test reduction - Mean time to diagnose failures - Release quality trends - Mentor QA engineers and SDETs on AI-assisted testing practices. - Lead pilots, proofs of concept, and scaled rollout of AI testing capabilities. - Ensure compliance with enterprise policies for data handling and model usage. Qualifications - Hands-on experience with tools/languages such as Python, Java, JavaScript, SQL, and test tools like Selenium, Playwright, Cypress, Appium, JUnit, TestNG, PyTest, or similar. - Experience integrating with platforms such as Jira, Azure DevOps, GitHub, Jenkins, GitLab, or cloud test platforms. - Knowledge of test analytics, data pipelines, and observability/log analysis tools. - Strong architecture and design skills for scalable, secure enterprise solutions. - Experience building AI copilots or assistants for QA teams (Desired). - Familiarity with vector databases, model evaluation, and MLOps/LLMOps concepts (Desired). - Experience with cloud platforms such as AWS, Azure, or GCP (Desired). - Understanding of regulated environments and compliance requirements (Desired). - Certifications in test architecture, cloud, AI/ML, or enterprise architecture (Desired). - Hands-on experience with Python (Desired). - Development experience in AWS Cloud technology (Desired). - Experience in TDD, continuous integration, code review practice is strongly desired. - Experience with Apigee or other API gateways is a plus (Desired). - Experience with DevOps concepts and tools (e.g., CI/CD, Jenkins, Git) (Desired). - At least 2 years working on an Agile team with a solid understanding of Agile/Lean practices (Desired). - Understanding of a microservice architecture (Desired). - Experience load and performance testing (Desired). - Strong documentation skills (Desired). Requirements - Expert Level experience required. - This is a Contract position based out of Chicago, IL. Benefits - Medical, dental & vision - Critical Illness, Accident, and Hospital - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available - Life Insurance (Voluntary Life & AD&D for the employee and dependents) - Short and long-term disability - Health Spending Account (HSA) - Transportation benefits - Employee Assistance Program - Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position. Application Deadline This position is anticipated to close on May 31, 2026.
Related Guides
Related Categories
Related Job Pages
More Artificial Intelligence Jobs
• Data collection, evaluation, and annotation. • Pairwise comparisons. • Counting tasks. • Object tagging and labeling across different content types (audio, video, images, or collected data)
• Perform data collection, evaluation, and annotation • Conduct pairwise comparisons • Complete counting tasks • Tag and label objects across different content types (audio, video, images, or collected data)
AI Voice Trainer – Bengali
Wing AssistantWe're the World's Best Assistant. Hit "Learn More" to speak to an expert about transforming your business! 🚀
• Complete short voice recordings or conversation tasks for AI training purposes. • Follow clear project instructions to ensure natural, accurate, and usable speech data. • Join tasks when available; assignments may range from a few minutes to multiple hours. • Submit recordings through the designated online workflow or platform.
Multimodal AI Content Specialist - Intermediate, AI Community
TELUSTELUS is an award-winning, Canadian-based company that provides superior broadband and communication systems to customers throughout the northeastern Americas. Founded in 1990, TEL
Multimodal AI Content Specialist - Intermediate (AI Community) Preferred availability 4 to 40 hours per week Compensation USD 10 - 20 per hour About the Role: At TELUS Digital, we are teaching AI to see, hear, and understand the world just as humans do. As a Multimodal AI Content Specialist in our Global Community, you are at the forefront of the most exciting frontier in technology. We are moving beyond text-only models to create AI that can reason across images, videos, and audio in real-time. We look to you to ensure these complex, multi-layered outputs are accurate, contextually aware, and culturally resonant. At TELUS, you are helping to build the "eyes and ears" of the next generation of artificial intelligence. What You'll Do (Key Responsibilities): - Cross-Modal Verification: Evaluate the relationship between different data types (e.g., verifying if an AI-generated video perfectly matches a complex text prompt). - Visual-Semantic Analysis: Audit image and video datasets to ensure the AI correctly identifies complex objects, spatial relationships, and subtle cultural nuances. - Temporal & Contextual Auditing: Review long-form video content to ensure the AI maintains logical consistency and "memory" from the beginning of the clip to the end. - Multimodal Safety & Bias Detection: Identify safety risks that only appear when media are combined (e.g., an image that is safe on its own but becomes harmful when paired with specific text). - Instruction Tuning for Media: Help design complex prompts that teach models how to describe visual scenes with high technical or artistic precision. Mandatory Qualifications: - Education: Minimum of a Bachelor's Degree in Cybersecurity, Criminal Justice, Forensic Science, or Information Security. - Native Language: Native-level proficiency in your primary language is mandatory to identify localized document types and regional identity nuances. - English Proficiency: Minimum B1 (Intermediate) level English. - Analytical Eye: Exceptional attention to detail, specifically in identifying pixel-level anomalies in digital images. Assessment: In order to be hired into our community, you'll go through a subject-specific qualification exam that will determine your suitability for the position and complete ID verification. Payment: Currently, pay rates for experts range from $10 - $20 USD per hour Our Payment terms are defined for each project. Why Join the TELUS Digital AI Community: - Community Connection: Work remotely as part of a 1M+ diverse global AI Community of contributors and experts. - Impactful Expertise: Use your native language and academic degree to shape real-world AI systems and products used by millions every day. - Hands-on Innovation: Gain experience in the latest AI research, evaluation, and fine-tuning methodologies. - Global Collaboration: Collaborate with a network of specialists across 20+ domains and 500+ languages and dialects. - Flexible Engagement: Manage your own schedule while making a meaningful impact on the future of technology.
