Job Closed

This listing is no longer active.

Capgemini logo
Capgemini

Get the Future You Want

Senior AI Quality Engineer

QA EngineerQA EngineerOtherRemoteSeniorTeam 10,001+Since 1967H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

108 days ago

Salary

$122K - $177.4K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishAWS

Job Description

Senior AI Quality Engineer

Capgemini

• Participate across the AI solution lifecycle from requirements and design through development, testing, and deployment • Build and maintain systems that exercise agentic workflows against realistic scenarios, edge cases, and failure conditions • Define contracts, validation, and explicit failure behavior at integration points • Create shared libraries, reference harnesses, and validation utilities that teams can reuse • Architect agentic systems so correctness, safety, and expected behavior are enforced by design • Participate in solution design to identify likely failure patterns in agentic systems • Define and implement cost-conscious evaluation strategies for AI-enabled systems • Work with cross-functional program teams to translate customer and mission needs into criteria • Communicate estimates, progress, and technical tradeoffs clearly to development leads and product owners

Job Requirements

  • 5+ years of professional software engineering experience
  • Demonstrated experience building bespoke validation, evaluation, or testing frameworks for complex systems, using or expanding tools such as Playwright, pytest, k6, Guardrails AI, or similar frameworks
  • Data validation, schema enforcement, and contract testing experience in distributed or service-oriented architectures
  • Experience treating quality, reliability, and correctness as core design concerns
  • Experience defining, interpreting, and acting on quality signals to assess system readiness
  • Hands-on experience designing, building, and operating AI-powered systems, including agentic workflows or orchestrated LLM-based applications
  • Solid understanding of Amazon Web Services and its native AI/ML services
  • Practical experience integrating automation into CI/CD pipelines and delivering software in an iterative, agile environment
  • Working knowledge of security best practices relevant to regulated or mission-critical contexts
  • Proven ability to work effectively with cross-functional teams

Benefits

  • Paid Time Off
  • Paid Company Holidays
  • Medical, Dental & Vision Insurance
  • Optional HSA and FSA
  • Base and Voluntary Life Insurance
  • Short Term & Long-Term Disability Insurance
  • 401k Matching
  • Employee Assistance Program

Related Categories

Related Job Pages

More QA Engineer Jobs

QA Engineer108 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Test and validate features of our existing product to ensure high‑quality delivery • Analyze user stories and requirements to create clear, actionable test cases • Execute test plans across functional, regression, and edge‑case scenarios • Identify, document, and track defects, working closely with developers to ensure resolution • Communicate directly with support, product lead, and clients to understand reported issues and provide timely updates • Provide release confidence and validation reports to product leads • Collaborate with remote team members across multiple time zones • Identify tests and workflows that would benefit from automation and provide input to the automation team • Contribute to continuous improvement of testing processes, documentation, and best practices

Colombia
Job Closed
ServiceNow logo

Audience Data Quality & Readiness Lead

ServiceNow

ServiceNow provides cloud-based services that automate enterprise information technology operations. As an employer, ServiceNow offers a challenging, collaborat

QA Engineer108 days ago
OtherRemoteTeam 29,000Since 2004

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The Audience Data Quality & Readiness Lead sits within the Marketing Activation & Lifecycle Orchestration team. This person will own the standards, controls, and operating cadence that keep audiences usable, compliant, and consistently publishable across our MarTech/AdTech activation stack. Audience segments must maintain applicability across paid and unpaid channels with applicability for ABM and buying group marketing decisioning. This role ensures audiences stay reliable end to end, including CDP audiences, pixel-based audiences, and segments sourced from off-platform providers. You will partner cross-functionally to translate identity, consent, suppression, event signals, and scoring outputs into activation-ready segments used across owned, earned, and paid channels for ABM and Buying Group Marketing. - Define and champion the audience connectivity vision for buying group marketing. - Maintain an enterprise audience library with standardized naming, metadata, ownership, refresh cadence, and change control. - Build and govern model-based audiences (propensity, intent scoring, lookalike). - Operationalize off-platform provider segments and pixel-based audiences into governed activation segments. - Own identity resolution requirements within activation workflows. - Define and enforce activation readiness standards for audience segments. - Implement quality controls to catch broken pipelines, schema drift, destination mapping issues, and ID mismatches. - Own and report SLAs for audience freshness, publishing success rate, match rates by endpoint, and incident remediation timelines. - Run operational reviews, drive root-cause remediation, and reduce repeat incidents and manual fixes. - Ensure consent and suppression requirements are consistently enforced across all segment sources. - Implement AI-based monitoring to detect match-rate drops, segment anomalies, latency issues, and suppression or consent failures. Qualifications - 7+ years in ABM marketing, audience activation, CDP operations, MarTech/AdTech operations, or data operations. - Demonstrated experience shaping audience strategy, not just executing it. Requirements - Adobe Experience Platform (AEP) and Adobe Real-Time CDP: destination publishing, segment operations, troubleshooting, governance. - Paid Activation Platforms: direct experience across programmatic, search, and social. - Pixel & Event-Based Segmentation: instrumentation dependencies and signal quality requirements. - Off-Platform Segment Operationalization: intent, syndicated audiences, and onboarding feeds with quality validation. - Identity Resolution: ID mapping, identity graphs, match rate drivers by endpoint. - Consent & Suppression Enforcement: translating policy into executable, audit-ready activation workflows. - SLA Design & Incident Response: operational monitoring, root-cause remediation across pipelines. Benefits - Base pay of $155,400 - $272,000, plus equity (when applicable), variable/incentive compensation and benefits. - Health plans, including flexible spending accounts. - 401(k) Plan with company match. - ESPP, matching donations, a flexible time away plan and family leave programs.

United States
Job Closed
TerraScale logo

Mid-Level QA Engineer

TerraScale

We apply core technologies to architecture, development, maintenance, support and future platforms evolution.

QA Engineer108 days ago
ContractRemoteTeam 11-50Since 2016H1B No Sponsor

• Develop and execute comprehensive test plans and test cases • Perform manual functional and regression testing across multiple environments • Validate front-end UI/UX behavior across browsers and devices • Test API integrations and third-party services • Identify, document, and track defects through resolution • Collaborate with developers to reproduce and resolve issues • Participate in sprint planning and review processes • Contribute to improving QA processes and documentation standards • Help ensure releases meet performance and stability expectations

Nigeria
Job Closed
Full TimeRemoteTeam 10,001+Since 1978H1B No Sponsor

• Execute manual test cases for web, mobile, or backend applications • Support basic automation testing activities, including: Running existing automated test suites • Maintaining simple automated scripts under guidance • Assisting with test data management for automated tests • Identify, document, and report defects clearly and accurately • Continuously learn new tools, methodologies, and product functionalities

Mexico
Job Closed