• Develop and maintain automated test scripts for Salesforce solutions and middleware integrations (e.g., Mulesoft, Apigee) using Java, Selenide, JUnit/TestNG, and related tools. • Validate data flows and integration points between systems using REST/SOAP APIs, Webhooks, and authentication protocols. • Design and execute functional, regression, and end-to-end tests for Salesforce configurations, customizations, and workflows. • Conduct API testing using Postman and support test coverage for integration-heavy applications. • Collaborate with Product Owners, Developers, and QA team members to define test cases, acceptance criteria, and coverage for user stories. • Track and manage test execution and defects using tools like TestRail, Allure TestOps, or Zephyr. • Contribute to the continuous improvement of automation strategy, test design, and QA best practices in an Agile environment. • Maintain test documentation and ensure traceability and compliance with security and quality standards.

• Define and lead the end-to-end testing strategy for Outreach’s GenAI platform, including agentic workflows, LLM tool calls, LangGraph orchestration, and supporting ML pipelines. • Design and implement evaluation systems that handle both deterministic and non-deterministic outputs. • Own testing across Outreach’s suite of AI agents. • Work closely with Data Science, MLOps, and platform engineers to ensure testability is designed in from the start. • Integrate evaluation pipelines into CI/CD workflows. • Establish and track metrics that matter for AI systems: answer quality scores, tool invocation accuracy, hallucination rates, latency, and regression trends over model and prompt changes. • Define standards for AI testing across the org — including prompt regression testing, retrieval quality evaluation, and agent behavior contracts. • Raise the quality bar across engineering teams by mentoring engineers. • Actively track developments in AI evaluation tooling, LLM benchmarking, and testing research.

• Own end‑to‑end quality for assigned features, components, or services • Design and execute functional, integration, system, and regression testing • Perform exploratory testing to uncover edge cases and failure scenarios • Identify, document, and track defects with clear reproduction steps and impact analysis • Prioritize effectively, stay focused, and drive tasks through to completion • Design, develop, and maintain automated test cases for APIs, backend systems, and/or UI • Actively participate in CI/CD pipelines to support continuous testing • Work closely with developers, product managers, and other QA engineers • Participate in requirement and design reviews to ensure testability and risk coverage • Collaborate with developers to debug issues and validate fixes • Analyze test results and provide quality insights to support release decisions • Contribute to improving test coverage, tools, and processes

• Design and maintain test cases and test suites for product features • Participate in agile ceremonies including discovery, refinement, decomposition, sprint planning, and demos • Design, develop, and maintain automated test suites for APIs and mobile UI on iOS and Android platforms • Implement shift-left testing practices • Build and maintain test frameworks and tools for QA engineers and integrate them into CI/CD pipelines • Ensure the reliability and stability of testing infrastructure • Collaborate with TechOps and other teams to improve quality management processes and testing workflows • Investigate production issues and perform root cause analysis • Collaborate with backend and mobile developers to prevent regressions • Track quality metrics and automate routine QA activities • Advocate for product testability and mentor QA team members