• Carry out procedures to ensure that all information technology solutions and services meet company quality standards and user requirements • Design and execute test plans, manual and automated test scripts, and test cases based on project requirements and objectives • Perform system, integration, functional, data validation, and performance testing as well as facilitate user acceptance testing • Utilize test automation tools and scripts, where feasible, to streamline test cycle execution • Utilize test management tools to document test plans and to report test results and defects • Work is primarily task based testing and maintenance activities • Proactively provide status, raise issues, and communicate necessary information on a regular basis via stand-up meetings, 1-on-1 meetings, and/or impromptu occasions

• Create detailed, comprehensive, and well-structured test plans and test cases • Review tickets (bugs, enhancements, new features) and other technical documents to engage in each phase of the software development lifecycle • Create, run, repair, manual, and automated tests using frameworks like Playwright • Plan and build automated testing frameworks that integrate with development workflows - determining what to automate (regression tests, API endpoints, critical user flows) and when to run which tests • Estimate, prioritize, plan, coordinate, and perform quality testing activities • Collaborate closely with cross-functional scrum teams and across the larger company • Demonstrate best practices in everything you do, including meaningful test coverage and striving to ensure maintainability • Mentor junior QA team members and advocate for quality standards • Design and maintain test data strategies, including creating hundreds of thousands of Salesforce records for performance testing, managing data versions, and ensuring clean test environments • Design and execute performance testing strategies to identify system bottlenecks, load limits, and optimization opportunities using appropriate testing tools • Integrate automated tests into CI/CD pipelines (GitHub Actions, Cumulus CI, MetaDeploy) to provide fast feedback on code changes and act as deployment gates

• Establishing and maintaining quality standards for all Virtual Design and Construction deliverables. • Building and managing the QA and QC framework for the department. • Leading the development of standardized processes and ensuring consistent model and documentation quality across all projects. • Working closely with the VDC Operations Manager to support day to day execution and retain ownership of VDC quality systems, audits, controls, and cross functional alignment. • Performing regular audits of VDC models, drawings, documentation, and workflows to ensure alignment with department standards. • Developing and maintaining quality dashboards, audit logs, and performance summaries. • Collaborating with cross functional teams to ensure VDC quality standards integrate with upstream and downstream workflows.

• Develop comprehensive test strategies: Create and maintain test plans covering functional, performance, and regression testing for AI agents and automation workflows. • Build and maintain automated test frameworks: Develop and maintain automated test scripts/frameworks to ensure bot responses and workflow outputs remain accurate, consistent, and reliable over time. • Build and maintain test assets: Create/curate golden conversation sets, synthetic test data, evaluation rubrics, and regression suites to measure quality over time. • Validate AI agent safety and reliability: Test tool-calling end-to-end (tool selection, parameter mapping, sequencing, retries/timeouts, error handling, and recovery), including negative/edge cases; confirm outputs align to business rules and document risk mitigations. • Test integration/workflow integrity: Validate API contracts, data transformations, and downstream impacts (idempotency, duplicate prevention, partial failures, and latency) across environments. • Manage defects through resolution: Identify, log, prioritize, and track defects; partner with developers to reproduce issues and validate fixes. • Provide release certification: Deliver final quality sign-off prior to production release, ensuring defined acceptance criteria and quality standards are met. • Align on acceptance criteria: Partner with Business Analysts to ensure user stories include clear, testable acceptance criteria and that test coverage maps to requirements. • Document testing and metrics: Maintain test cases, data, results, and quality metrics; communicate outcomes and risks. • Participate in Agile ceremonies: Engage in planning, grooming, standups, and retrospectives to embed quality throughout delivery. • Drive continuous improvement: Identify opportunities to improve automation coverage, testing effectiveness, and quality practices.