Autodesk logo
Autodesk

How the world gets designed and made. #MakeAnything

Senior QA Automation Engineer – AI Applications

SDETSDETFull TimeRemoteSeniorTeam 10,001+Since 1982H1B No SponsorCompany SiteLinkedIn

Location

Canada

Posted

2 days ago

Salary

$84K - $123.2K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishJenkinsPython

Job Description

Senior QA Automation Engineer – AI Applications

Autodesk

• Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features. • Automate QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins), leveraging AI-powered testing tools to improve test development, maintenance, and coverage. • Create and maintain test harnesses for AI services, applications, and APIs. • Perform API testing for AI services and backend systems. • Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features. • Test AI/ML applications and machine learning models from a product and user perspective. • Evaluate AI/ML model outputs for correctness, consistency, and expected application behavior. • Define structured rubrics that translate qualitative findings into measurable evaluation gates. • Build quality gates for CI/CD and deployment pipelines, including automated regression and integration testing. • Mentor teams on QA automation best practices and consistent quality standards for AI-powered applications. • Contribute to multi-team projects and codebases, ensuring code quality and consistency. • Participate in code reviews and provide constructive feedback to peers. • Document and present findings and ideas across the company.

Job Requirements

  • Bachelor’s degree in Computer Science, Engineering, or equivalent experience
  • 5+ years of professional experience in software quality assurance, test automation, or software engineering
  • Strong programming skills in Python, with experience in test automation
  • Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality
  • Experience with CI/CD tools and processes
  • Familiarity with popular CAD environments and tooling
  • Proficient in automation and UAT test suites/frameworks
  • Experience designing QA frameworks or platforms used by multiple teams
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • Understanding of software architecture and design patterns
  • Ability to work in an Agile development environment.

Benefits

  • Annual cash bonuses
  • Commissions for sales roles
  • Stock grants
  • Comprehensive benefits package

Related Categories

Related Job Pages

More SDET Jobs

BJAK logo

Software QA Engineer – Policy & Claims Automation

BJAK

Bjak is a technology company focused on making financial services easy, fun and more rewarding for everyone

SDET2 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Design and execute test strategies for policy issuance and claims automation systems. • Build and maintain test coverage across web, API and backend workflow systems. • Validate end-to-end insurance processes including policy creation, updates, claims submission, assessment and resolution. • Identify edge cases, workflow gaps and failure scenarios in complex insurance processes. • Improve regression testing coverage to reduce recurring defects in policy and claims systems. • Work closely with engineers and product teams to validate features before release. • Track, document and report bugs with clear reproduction steps and business impact analysis. • Support manual testing for complex workflows where automation is not yet sufficient. • Improve QA processes, test standards and overall system quality practices. • Continuously improve reliability of policy and claims workflows through structured testing.

China
BJAK logo

QA Automation Engineer – Release Quality

BJAK

Bjak is a technology company focused on making financial services easy, fun and more rewarding for everyone

SDET2 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Own and improve release validation and regression testing for production deployments. • Build and maintain automated test suites for web, API and workflow systems. • Design release test coverage for insurance workflows including quotes, policy issuance, endorsements, claims and payments. • Improve pre-release checks, smoke testing and production readiness validation. • Work closely with engineers to validate changes before deployment to production. • Identify critical edge cases, failure paths and risks in multi-step workflows. • Track, document and report bugs with clear reproduction steps and release impact analysis. • Support manual release testing when automation coverage is not sufficient. • Improve QA processes, release gates and overall deployment confidence. • Continuously reduce regression issues and production defects through better testing strategy.

China
BJAK logo

Test Automation Engineer – API & Web

BJAK

Bjak is a technology company focused on making financial services easy, fun and more rewarding for everyone

SDET2 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Build and maintain automated test suites for API and web-based systems. • Design test coverage for end-to-end insurance workflows including quotes, policy issuance, endorsements, claims and payments. • Develop API-level validation for core business logic and workflow transitions. • Build UI automation tests for critical customer-facing and internal systems. • Improve regression testing coverage to reduce production defects. • Work closely with engineers and product teams to validate features before release. • Identify edge cases, API failure scenarios and UI inconsistencies. • Track and document bugs with clear reproduction steps and system impact analysis. • Support manual testing for complex or evolving workflows where needed. • Improve QA automation frameworks, practices and overall test reliability.

China
BJAK logo

QA Automation Engineer – AI Workflow Systems

BJAK

Bjak is a technology company focused on making financial services easy, fun and more rewarding for everyone

SDET2 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Build and maintain automated test suites for web, API and backend workflow systems. • Design test coverage for end-to-end insurance flows including quotes, policy issuance, endorsements, claims and payments. • Improve regression testing, release validation and pre-production quality gates. • Work closely with engineers and product teams to identify issues earlier in the development cycle. • Track, document and report bugs clearly with strong reproduction steps and impact analysis. • Support manual testing for complex or newly built workflows where automation is not yet available. • Improve QA processes, test strategies and documentation standards across teams. • Identify edge cases, failure paths and workflow gaps in complex multi-step systems. • Continuously improve release confidence and reduce production defects.

China