How the world gets designed and made. #MakeAnything
Senior QA Automation Engineer – AI Applications
Location
Canada
Posted
2 days ago
Salary
$84K - $123.2K / year
Seniority
Senior
Job Description
Senior QA Automation Engineer – AI Applications
Autodesk
• Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features. • Automate QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins), leveraging AI-powered testing tools to improve test development, maintenance, and coverage. • Create and maintain test harnesses for AI services, applications, and APIs. • Perform API testing for AI services and backend systems. • Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features. • Test AI/ML applications and machine learning models from a product and user perspective. • Evaluate AI/ML model outputs for correctness, consistency, and expected application behavior. • Define structured rubrics that translate qualitative findings into measurable evaluation gates. • Build quality gates for CI/CD and deployment pipelines, including automated regression and integration testing. • Mentor teams on QA automation best practices and consistent quality standards for AI-powered applications. • Contribute to multi-team projects and codebases, ensuring code quality and consistency. • Participate in code reviews and provide constructive feedback to peers. • Document and present findings and ideas across the company.
Job Requirements
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience
- 5+ years of professional experience in software quality assurance, test automation, or software engineering
- Strong programming skills in Python, with experience in test automation
- Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality
- Experience with CI/CD tools and processes
- Familiarity with popular CAD environments and tooling
- Proficient in automation and UAT test suites/frameworks
- Experience designing QA frameworks or platforms used by multiple teams
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Understanding of software architecture and design patterns
- Ability to work in an Agile development environment.
Benefits
- Annual cash bonuses
- Commissions for sales roles
- Stock grants
- Comprehensive benefits package
Related Guides
Related Categories
Related Job Pages
More SDET Jobs
Software QA Engineer – Policy & Claims Automation
BJAKBjak is a technology company focused on making financial services easy, fun and more rewarding for everyone
• Design and execute test strategies for policy issuance and claims automation systems. • Build and maintain test coverage across web, API and backend workflow systems. • Validate end-to-end insurance processes including policy creation, updates, claims submission, assessment and resolution. • Identify edge cases, workflow gaps and failure scenarios in complex insurance processes. • Improve regression testing coverage to reduce recurring defects in policy and claims systems. • Work closely with engineers and product teams to validate features before release. • Track, document and report bugs with clear reproduction steps and business impact analysis. • Support manual testing for complex workflows where automation is not yet sufficient. • Improve QA processes, test standards and overall system quality practices. • Continuously improve reliability of policy and claims workflows through structured testing.
QA Automation Engineer – Release Quality
BJAKBjak is a technology company focused on making financial services easy, fun and more rewarding for everyone
• Own and improve release validation and regression testing for production deployments. • Build and maintain automated test suites for web, API and workflow systems. • Design release test coverage for insurance workflows including quotes, policy issuance, endorsements, claims and payments. • Improve pre-release checks, smoke testing and production readiness validation. • Work closely with engineers to validate changes before deployment to production. • Identify critical edge cases, failure paths and risks in multi-step workflows. • Track, document and report bugs with clear reproduction steps and release impact analysis. • Support manual release testing when automation coverage is not sufficient. • Improve QA processes, release gates and overall deployment confidence. • Continuously reduce regression issues and production defects through better testing strategy.
Test Automation Engineer – API & Web
BJAKBjak is a technology company focused on making financial services easy, fun and more rewarding for everyone
• Build and maintain automated test suites for API and web-based systems. • Design test coverage for end-to-end insurance workflows including quotes, policy issuance, endorsements, claims and payments. • Develop API-level validation for core business logic and workflow transitions. • Build UI automation tests for critical customer-facing and internal systems. • Improve regression testing coverage to reduce production defects. • Work closely with engineers and product teams to validate features before release. • Identify edge cases, API failure scenarios and UI inconsistencies. • Track and document bugs with clear reproduction steps and system impact analysis. • Support manual testing for complex or evolving workflows where needed. • Improve QA automation frameworks, practices and overall test reliability.
QA Automation Engineer – AI Workflow Systems
BJAKBjak is a technology company focused on making financial services easy, fun and more rewarding for everyone
• Build and maintain automated test suites for web, API and backend workflow systems. • Design test coverage for end-to-end insurance flows including quotes, policy issuance, endorsements, claims and payments. • Improve regression testing, release validation and pre-production quality gates. • Work closely with engineers and product teams to identify issues earlier in the development cycle. • Track, document and report bugs clearly with strong reproduction steps and impact analysis. • Support manual testing for complex or newly built workflows where automation is not yet available. • Improve QA processes, test strategies and documentation standards across teams. • Identify edge cases, failure paths and workflow gaps in complex multi-step systems. • Continuously improve release confidence and reduce production defects.

