We provide cross-platform linking and attribution solutions to the world's leading digital brands.
AI Testing and Delivery Automation Engineer
Location
Canada
Posted
3 days ago
Salary
$140K - $160K / year
Seniority
Lead
Job Description
AI Testing and Delivery Automation Engineer
Branch
• Own, design, and drive how testing is implemented across the system • Shape and evolve the testing stack end-to-end (Playwright, Karate, Pact, Postman, etc.) • Define the approach for creating, reviewing, executing, and maintaining test cases and test scripts • Drive adoption of AI-assisted testing (Claude Code, Windsurf, Copilot) • Work hands-on with teams to get them started, helping define test cases, write initial tests • Build and own a scalable regression and smoke testing approach • Own the integration of testing into CI/CD pipelines • Work with Engineering and Infrastructure teams to define, establish, and improve test environments • Continuously improve test reliability, reduce flakiness, and drive clear processes for test results • Define and drive testing metrics (coverage, reliability, execution, failures) • Drive adoption of testing standards across Engineering and Product
Job Requirements
- 7+ years of experience in software engineering, test automation, or quality engineering
- Strong hands-on experience with test automation across multiple layers (API, service, UI)
- Experience building and scaling test frameworks and automation practices
- Strong understanding of modern testing tools and approaches (Playwright, Karate, API/contract testing, etc.)
- Experience integrating testing into CI/CD pipelines and working with modern development workflows
- Ability to design testing strategies, define coverage, and establish standards across teams
- Hands-on coding experience and ability to write and review test code as needed
- Experience working closely with Engineering and Product teams in a cross-functional environment
- Strong communication skills with the ability to drive alignment and adoption across teams
- Experience improving test reliability, reducing flakiness, and maintaining long-term test quality
- Experience adopting AI into QA practices, including using tools like Claude Code, Cursor, Windsurf, or Copilot
Benefits
- Comprehensive benefits package
- Health and wellness programs
- Paid time off
- Retirement planning options
- 10% annual bonus tied to company goals
Related Guides
Related Categories
Related Job Pages
More QA Automation Engineer Jobs
Role Description The project for which the client is staffing requires good working knowledge in Playwright. The Automation QA Engineer should have good hands-on experience in the following: - Simple code to launch browser and open google.com and type something in the search box and click enter - playwright.config.ts - package.json - handling dropdowns - storage state - Waits - Fixtures - Dynamic Locators As part of the coding skills assessment, the Automation QA Engineer will be asked to share his screen and open Notepad, Notepad++, or a Word document, assuming that a Word document is a basic tool each system would have. Qualifications - 5+ years of QA experience, covering both manual and automated testing. - Hands-on experience with Selenium, TypeScript, and Playwright, including building and maintaining automated test suites. - Solid experience in performance testing for data pipelines. - Strong ability to test, validate, and troubleshoot data pipelines end-to-end. - Familiarity with C# is a plus. - Excellent English communication skills — clear, concise, and direct in both written and verbal interactions. Requirements - Playwright is a must with hands-on experience. - Comfortable working within the Azure ecosystem, including Azure Portal, Application Insights, Containers, and related monitoring tools. - Proven capability in setting up, tracking, and analyzing code quality metrics to drive continuous improvement. - Highly proactive, autonomous, and demonstrates strong ownership and accountability. Company Description
• Working in a Scrum Squad of 3-4 other Developers and 1 other Automation QA • Following and maintaining established QA best practices within the squad • Collaborating with the Product Owner and Squad to refine Stories and Acceptance Criteria, including criteria for AI-driven features • Collaborating with the squad to design and review test scenarios and develop C# Integration Tests, React tests in Playwright, Contract Tests (Pact) and UI Functional Tests in C# with Playwright • Quickly identifying high-level test strategies and quality risks, including those unique to AI/ML systems (hallucination, drift, latency) • Monitor and report on quality trends such as bug churn • Leveraging AI tooling (e.g. GitHub Copilot, AI test generation tools) to accelerate test authoring and analysis • Analyze automation test run results • Adhering to existing coding standards and practices • Partaking in code review culture and technical collaboration • Attending squad meetings such as daily Stand-ups, Retrospectives, Planning, Refinements, and technical discussions • Partaking in presentations and code workshops
• Building our next generation IT workflow automation tooling using Temporal and Go running on Kubernetes. • Collaborate with the engineering team on dogfooding Teleport, specifically Teleport Identity (identity governance) and Teleport Policy (access policies). • Building hardened security & automation for macOS endpoints. • Writing IT automation using tools like Terraform, shell scripts, and Go. • Writing integrations with tools like Panther, Jamf Pro, Okta, Rippling, Google Chrome Enterprise. • Traditional IT Helpdesk tasks of helping internal customers with access, lockout, integrations, and configuration.
• Design, build, and maintain automation workflows across IT systems and SaaS platforms. • Develop integrations between Microsoft services, Google Workspace, and other tools using APIs. • Automate operational tasks (user management, notifications, data sync, access workflows). • Implement reliable and secure automation (logging, monitoring, error handling). • Optimize existing processes to reduce manual work and improve efficiency. • Collaborate with IT, Security, and business teams to deliver automation solutions. • Document workflows, scripts, and integrations.



