SitusAMC logo
SitusAMC

We're helping our clients identify and capture opportunities across the entire lifecycle of their real estate activity.

AI Quality Assurance, Prompt Team

QA EngineerQA EngineerFull TimeRemoteSeniorTeam 5,001-10,000H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

3 days ago

Salary

$110K - $130K / year

Seniority

Senior

Bachelor Degree6 yrs expEnglish

Job Description

AI Quality Assurance, Prompt Team

SitusAMC

• Define, execute, and continuously improve quality assurance standards for AI agent and prompt outputs, ensuring generated responses meet expectations for accuracy, consistency, completeness, and explainability. • Oversee QA activities throughout the AI lifecycle, including pre‑deployment validation and post‑deployment output monitoring (regression testing). • Ensure AI outputs support informed decision-making by validating clarity, applicability, and alignment with intended business value. • Serve as an advocate for high-quality AI outputs, promoting shared understanding of output standards and expectations across the organization. • Lead and oversee QA Analysts responsible for reviewing and evaluating AI agent and prompt outputs. • Provide direction, coaching, and prioritization to ensure consistent application of output QA standards and timely completion of QA activities. • Forecast QA timelines and capacity in coordination with AI leadership to support delivery commitments and ensure deadlines are met. • Coordinate cross team to align QA activities with delivery timelines and ensure prompt and agent readiness. • Assist with the development of repeatable AI output evaluation approaches that can be applied across use cases to drive efficiency and consistency. • Document QA findings, trends, and recurring issues related to AI agent and prompt outputs. • Prepare reports, summaries, and presentations for management outlining QA results, risks, and improvement opportunities. • Identify opportunities to improve QA processes, tools, and standards based on observed output behavior and delivery feedback.

Job Requirements

  • Bachelor’s degree in a relevant field (such as Business, Computer Science, Data Science, Engineering, or related discipline), or equivalent combination of education and experience.
  • Minimum of 6+ years of industry and/or relevant experience, typically with 1+ years in a Senior Associate level role or external equivalent.
  • 8+ years of relevant professional experience, with demonstrated involvement in AI, analytics, content evaluation, automation, or quality assurance disciplines.
  • Prior QA management experience preferred, including oversight of analysts or reviewers responsible for evaluating outputs or deliverables.
  • Prior leadership experience preferred, with the ability to coordinate work, forecast timelines, and drive accountability across teams.
  • Demonstrated experience evaluating AI-generated outputs, including prompts, agent responses, or decision-support content.
  • Strong understanding of how prompt design, instructions, and context influence AI agent behavior and output quality.
  • Excellent written and verbal communication skills, with the ability to explain quality findings and recommendations to both technical and non-technical stakeholders.
  • Strong analytical and critical thinking skills, with attention to patterns, edge cases, and systemic quality issues.
  • Experience working in Agile or delivery-oriented environments, coordinating priorities across multiple stakeholders.
  • Real estate, mortgage, or financial services experience preferred, but not required.

Benefits

  • PTO and paid holidays
  • Health insurance
  • Dental insurance
  • Vision insurance
  • Life insurance
  • Disability insurance
  • 401K

Related Categories

Related Job Pages

More QA Engineer Jobs

Irth Solutions logo

QA Analyst

Irth Solutions

The Most Complete SaaS Platform for Damage Prevention, Asset Protection and Risk Management

QA Engineer3 days ago
Full TimeRemoteTeam 51-200Since 1995H1B No Sponsor

• Execute manual regression test scripts across release candidates, covering new features and existing functionality • Validate functionality across a broad range of application modules, workflows, and user roles • Perform smoke testing, feature testing, and onboarding regression validation • Apply boundary and negative testing techniques to validate data integrity, edge cases, and error handling — particularly important for engineering data inputs and threshold-driven calculations • Test against multiple client configurations and environments • Support the development and execution of API and integration test cases as the team expands its testing coverage • Log defects in Azure DevOps with clear reproduction steps, screenshots, and test data • Triage and validate bug fixes; conduct regression on resolved defects • Leverage Azure App Insights to capture additional error context where applicable • Communicate clearly with developers to ensure defects are well-understood and actionable • Create, update, and organize test cases and test suites within Azure DevOps • Maintain the Master Test Script List as new features and modules are released • Contribute to the Functional, Onboarding, and CIM Smoke Regression suites • Collaborate with developers, product managers, and the QA Manager to align on priorities and release readiness • Provide QA status updates and escalate risks to the QA Manager in a timely manner

United States
Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

• Modelar, elaborar e executar testes funcionais, regressivos, exploratórios; • Levantar os critérios de aceite baseados nas regras de negócio das histórias de negócio; • Vivência em metodologias ágeis (Scrum/Kanban); • Versionamento de código fonte de automação de casos de testes; • Execução e geração de evidência de execução de testes manuais/automatizados; • Elaboração relatórios de resultados de testes planejados versus testes realizados para a gestão; • Geração de massa de dados para testes

Brazil
Sperton Global AS logo

API QA Engineer

Sperton Global AS

Sperton is a global recruitment and consulting firm with offices across Europe, Asia, and the Americas. We help companies find and manage top talent across borders, delivering fast, compliant, and flexible recruitment, consultant hiring, and global mobility services.

QA Engineer3 days ago
Full TimeRemoteTeam 51-200

Role Description We are seeking an experienced Senior QA Engineer for one of our clients based in Manila to join a collaborative quality assurance team. This role is heavily focused on API and backend testing — you will serve as a cornerstone of quality validation for complex, data-driven systems. While no development background is required, you must be technically strong, analytically sharp, and a confident communicator who can work cross-functionally with engineers and stakeholders. Key Responsibilities - Design, execute, and maintain comprehensive API test cases for backend services with minimal to no UI involvement - Perform end-to-end API testing using tools such as Postman, REST Assured, or equivalent platforms - Read, write, and execute SQL queries to validate data integrity, trace issues through the database, and support root cause analysis - Navigate and interact with databases to verify expected data behavior and support test coverage - Identify, document, and track defects with clear reproduction steps and supporting evidence - Collaborate closely with the QA team and cross-functional stakeholders to align testing scope with project requirements - Communicate findings, risks, and test status clearly to both technical and non-technical audiences - Contribute to process improvement initiatives and help maintain documentation of test strategies and coverage - Support occasional UI testing as the role scope evolves over time Qualifications - 3–5 years of hands-on QA experience with a strong focus on API and backend testing - Demonstrated expertise with API testing tools (Postman, SoapUI, REST Assured, or similar) - Solid working knowledge of SQL — ability to read, write, and interpret queries independently - Experience navigating and validating data within relational databases - Strong understanding of testing methodologies, SDLC, and defect management processes - Excellent written and verbal communication skills; able to translate technical findings clearly - Ability to work independently while collaborating effectively with a distributed team - Comfortable operating in an Agile or hybrid delivery environment Nice to Have - Experience with automation scripting or frameworks (even without a full development background) - Familiarity with CI/CD pipelines and integration of tests into automated build processes - Background in performance or load testing - ISTQB or equivalent QA certification Company Description This Position is Sponsored by Sperton Global, a recruitment and consulting company with an international reach. We are committed to helping our clients achieve success in their hiring processes, finding the right people for the right positions.

Philippines
Zwift logo

Senior QA Analyst

Zwift

We are the fitness company born from gaming. And we’re on a mission to make more people, more active, more often.

QA Engineer3 days ago
Full TimeRemoteTeam 501-1,000Since 2014H1B Sponsor

• Foster strong, communicative team spirit supporting our globally full-stack development efforts, supporting frontend and backend • Collaborate with cross-functional teams, including developers, product managers, and designers, to create detailed test plans and test cases based on project requirements and specifications • Define test strategy and lead testing from requirements gathering to release phase • Organize and perform regression and feature testing to reveal bugs in software • Craft detailed, reproducible, and concise bug reports • Help design, refine, and distribute QA reports and feedback to development, product managers, customer support, and senior management • Participate in technical design and provide a voice for testability and quality • Continually improve test cases to ensure coverage on all Zwift software products • Identify, source, define, and implement useful, specialized tools and/or methods to benefit process, automation, and reporting

California
$70.5K - $110K / year