This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description 8am is looking for a Senior Quality Engineer to join our LawPay team. At 8am, quality is not a phase—it’s a mindset woven into every conversation, decision, and line of code. As a senior member of the team, you’ll leverage your deep testing expertise to drive quality improvements that impact not just your immediate team, but the broader engineering organization. You’ll mentor junior engineers, contribute to process improvements, and take ownership of quality initiatives that protect and enhance our customers’ experience. What you'll do: - Work effectively as an embedded engineer on a scrum team, and across teams when user features span multiple teams, contributing meaningfully to technical discussions. - Design and execute comprehensive test strategies across UI and API layers, ensuring they reflect real customer scenarios. - Write high-quality test cases that tell a story about customer interactions, and maintain them throughout their entire lifecycle. - Contribute tests to our Python/Playwright/pytest automation framework, expanding coverage for both UI and API scenarios. - Champion the customer experience at every stage of development, viewing deliverables through the customer’s lens. - Identify and document defects with comprehensive root cause analysis. - Drive continuous improvement in our Defect Leakage Rate, recognizing that every bug reaching production erodes customer trust. - Proactively engage with Product Owners and Product Management on feature feasibility, testability, and requirement clarification—raising concerns before work enters the sprint, not after. - Become a Subject Matter Expert (SME) for specific technical areas or product components. - Collaborate with SDET team members and developers to determine which tests are high-value candidates for automation. Qualifications - 5+ years of experience in software quality engineering, preferably in SaaS environments. - Highly self-directed: able to own your workload, define your own test approach, and drive quality without waiting to be told what to cover. - Hands-on experience testing both UI (browser-based) and API layers, with a strong grasp of REST API testing concepts. - Proficiency with Postman or equivalent REST clients for exploratory and structured API testing. - Working knowledge of Python sufficient to read, write, and contribute tests to an existing pytest-based automation framework. - Comfort navigating multi-tenant, API-driven SaaS platforms and understanding how platform-level changes ripple across features. - Strong communication skills with the ability to present to both technical and non-technical stakeholders. - Proficiency working in shell environments like bash or zsh, especially for searching and reading log files. - Proficiency with test management tools such as Qase. - Familiarity with version control using Git, both in the CLI and through services like Bitbucket and GitHub. - Experience managing locally hosted test environments using tools like Docker. - Experience mentoring junior engineers and contributing to process improvements. - Basic understanding of containerization, Kubernetes, and CI/CD pipelines (Jenkins, CircleCI). Nice to Haves - Familiarity with Ruby on Rails applications—comfortable reading logs, navigating the stack, and understanding application behavior without needing to write application code. - Experience with Playwright, Cypress, or Selenium for UI test automation. - Knowledge of foundational nonfunctional testing (performance, accessibility, security). - Experience with microservices architectures and distributed systems. - Certifications such as ISTQB or CSTE. - Familiarity with AI-assisted testing tools and leveraging LLMs as a productivity-boosting tool. Benefits - Health Insurance Coverage: A variety of medical, dental, and vision plans, including a 100% company-paid HDHP plan for employees. - Financial perks: Competitive compensation and benefits package including annual bonuses, equity options, and 401(k) or RRSP if in Canada, with a company match for all team members. - Time for what matters: Flexible Time Off, paid holidays, and a parental leave program for new parents. - Wellness: Wellness stipends, mental health support, and one-on-one nutrition coaching. - Learning and Development: Continuous learning through 8am.edu, leadership programs, professional development funds, and individually focused talent development. - Giving back to the communities around us: Participate in our charitable matching gift program, paid time off for volunteer service, and company-sponsored volunteer events (both local and virtually). - Engagement: Virtual and in-person team-building events, quarterly award recognition through our Rise & Shine Award of Excellence Program, and our peer-to-peer appreciation platform.

• Architect & Scale AI Evaluation Systems: Design and oversee the end-to-end framework for testing AI agent systems at scale. You will leverage LLM-driven methodologies—including automated simulations, "LLM-on-LLM" rubrics, and adversarial red-teaming—to ensure reliability, policy adherence, and logic across complex, multi-turn conversational flows. • Drive Deployment Excellence: Partner with Forward Deployed Engineers and PMs to triage issues, identify bottlenecks, and create new test cases on the fly to address real-world deployment challenges. • Be the Customer’s Voice: Conduct manual UAT and voice-call testing to represent the end-customer experience. You take it personally when an agent lacks empathy or clarity, and you excel at articulating these nuances to the engineering team and clients. • Lead and Scale the Team: lead a pod of QA analysts and partners. You will define the best practices, communication loops, and shared knowledge base that allow the QA function to scale alongside our rapidly growing product line.

• Monitor and provide feedback on the quality of phone interactions with participants by evaluating calls of representatives and advisors • Provide continuous call evaluation feedback to representatives and advisors through written evaluations • Document and escalate call monitoring issues to management as necessary • Evaluate representatives and advisors calls using the quality monitoring data management system to compile and track performance at an individual level • Extract and organize metrics to create month-end reporting and analysis on call monitoring results for internal quality reports • Facilitate call calibration exercises to validate calls are monitored consistently • Partner with internal resources (Compliance, Legal, Supervision, Training) on training and resources • Identify performance gap trends, conduct need/skill gap analysis • Contribute to appropriate learning solutions and documentation support • Participate in various training related projects, including developing training materials, attending meetings, and facilitating training for new representatives, advisors, and managers

• Lead the audience testing and operational oversight of quality assurance framework for communications delivered through proprietary marketing automation platforms • Partner with Business Analysts and engineers reviewing technical documentation, foresee any data challenges and build test strategies to align to requirements. • Translate technical campaign requirements into structured test plans, timelines, resource planning and effort estimation. • Partner with data teams, solution architects, and IT to ensure proper system integration, data accuracy, and campaign execution readiness. • Identify operational risks, process constraints, and cross-functional dependencies impacting testing procedures and campaign delivery. And suggest mitigation plans. • Build, lead, and develop a team of QA analysts, set expectations, coach performance, and grow automation capabilities. • Partner cross-functionally to redesign testing process to meet evolving data infrastructure and architecture. • Investigate data discrepancies and complete root cause analysis on expedited timelines without impacting campaign deliverables.