• Design and implement comprehensive testing strategies for GenAI features, including conversational AI, agentic systems, and LLM-powered workflows • Develop automated test suites for prompt testing, including regression tests that detect unintended changes in model behaviour • Create evaluation frameworks to measure GenAI quality across multiple dimensions (accuracy, relevance, safety, consistency, latency) • Build and maintain test datasets and golden examples that represent diverse user scenarios and edge cases • Implement monitoring and alerting systems to detect quality degradation in production GenAI features • Perform adversarial testing to identify potential failures, hallucinations, biases, or security vulnerabilities in AI systems • Collaborate with engineers to define acceptance criteria and quality gates for AI feature releases • Develop tools and frameworks that make it easy for engineers to test their GenAI implementations • Conduct user acceptance testing and gather feedback on AI feature performance from internal users • Document testing procedures, known issues, and quality metrics in clear, accessible formats • Partner with Product and Design teams to ensure AI features meet user experience standards • Stay current with GenAI testing methodologies, tools, and industry best practices

• Architect, deploy, and operate automated test frameworks for distributed systems • Develop integration, regression, and performance test suites for REST APIs, gRPC services, and event-driven components • Compose CI/CD pipeline tools verifying functionality, reliability, and service interactions across environments • Collaborate with developers to define microservice test strategies, fault-injection scenarios, resilience testing • Triage test results, root cause test failures, or performance drops and drive fixes • Drive continuous improvement of automation coverage, observability, and testing efficiency

About Us TherapyNotes is the go-to superhero for behavioral health Practice Management and EHR software! Our top-notch SaaS solution handles scheduling, billing, documenting, telehealth, and more so clinicians can focus on awesome patient care. We're a dynamic team of pros who love to innovate and push the envelope, keeping our software cutting-edge. Join us, and let's revolutionize behavioral health software together while making a real difference! Description Join our team as a Sr QA Engineer with an SDET focus, where your main mission will be designing and maintaining robust load testing solutions to validate scalability and reliability of our industry leading SaaS application, as well as writing automated tests for our API and UI layers. As a senior, you'll mentor and guide team members, sharing your expertise in automation and testing best practices. If you're a detail-oriented techie who loves a good challenge, this role is your playground. Responsibilities - Work with the existing QA and development team members to deliver a comprehensive load and test strategy - Design, maintain, and execute load, stress, and endurance tests - Identify performance bottlenecks and work with engineering to remediate performance issues - Integrate load and test automation into the CI/CD pipeline and increase the organization's speed to market - Make recommendations on how our current load and testing processes can be improved - Ensure that load testing and test plans are consistent with test activities across a diverse and distribute set of development teams - Test and validate software to ensure that it satisfies requirements and is free from defects - Analyze the root cause for testing failures and open appropriate tickets with sufficient findings - Manually test application components where automation is not a good fit - Mentor team members in testing strategies and automation design patterns Requirements - 8 or more years experience in an Agile, highly collaborative, team-based environment - 5 or more years experience developing API and UI test automation projects - 3 or more years experience developing and maintaining load testing environments - BS and/or MS in a technical discipline (Computer Science or Software Engineering preferred) - Expertise with OOP concepts and design patterns - Strong understanding of web and browser technologies - Strong understanding of software development languages such as C#, Java, JavaScript - Strong understanding of test automation frameworks such as Selenium, Cucumber Benefits - Competitive salary - $95,000-$125,000 - Employer sponsored health, dental, vision, life, and disability insurance - Retirement plan with company contribution - Annual company profit sharing - Personal development/training budget - Open, collaborative work environment - Extensive 2-week onboarding plan - Comprehensive mentorship program Equal Opportunity Employer Statement & Applicant Rights TherapyNotes LLC is an Equal Opportunity Employer and does not discriminate based on race, color, religion, sex, national origin, age, disability, genetic information, or any other protected status under federal, state, or local law. We are committed to providing a workplace free of discrimination and harassment.For more information about your rights under federal employment laws, please review the following: - Know Your Rights: Workplace Discrimination is Illegal - Family and Medical Leave Act (FMLA): Employee Rights Under FMLA If you require a reasonable accommodation during the application process, please contact humanresources@therapynotes.com. #LI-Remote #LI-AC1 2/23/2026

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The Test Automation Specialist will be responsible for developing and implementing the test automation framework and automated tests. This position will be a highly technical, hands-on role for all test automation efforts for the team. You will be tasked with meeting the current quality standards while integrating test automation into our processes. - Scale and maintain the test automation framework. - Collaborate with development and delivery teams to integrate test automation throughout the development lifecycle. - Automate low-maintenance test suites across multiple environments. - Create and maintain automated test suites for both UI and API testing. - Analyze and report test results, identify areas for improvement, and drive continuous improvement in our testing practices. - Act as a subject matter expert on test automation, providing guidance and support to other team members. - Initial projects will be continued test automation into our regression suite. Qualifications - Minimum of 2 years of experience in test automation development. - Experience with Java and Selenium. - Solid understanding of software testing principles, methodologies, and best practices. - Knowledge on integrating test automation into build pipelines (CI/CD tooling) and results into test tools. - Experience in testing strategies for cloud-based applications and services. - Ability to work independently and to carry out assignments to completion within parameters of instructions given, prescribed routines, and standard accepted practices. - Strong analytical and problem-solving skills. - Excellent verbal and written communication skills, including the ability to effectively communicate with internal and external business associates. - Must be able to work under pressure and meet deadlines, while maintaining a positive attitude and providing exemplary customer service. Requirements - Experience testing or developing payment processing systems. - Pega experience. - Wiremock and/or mocking services. - AI.