Control Tester & Advisor – Data & AI Governance
Location
Canada
Posted
2 days ago
Salary
$56K - $103.5K / year
Seniority
Senior
Job Description
Control Tester & Advisor – Data & AI Governance
BMO U.S.
• Execute design effectiveness (DE) and operating effectiveness (OE) testing of controls related to Data Governance and AI Governance, including data quality, data management, AI lifecycle governance, and ethical AI controls. • Develop and document test steps and test scripts aligned to approved testing methodologies and risk frameworks. • Perform reperformance testing, sampling, and evidence validation to assess control execution. • Apply professional judgment to determine control effectiveness, identify control gaps, and assess residual risk. • Provide risk, control, and process advisory support to business and technology partners related to Data and AI governance. • Advise on control design, control enhancements, and process improvements to address identified risks or emerging governance expectations. • Support and provide input into risk assessments, including identification of inherent risks, evaluation of mitigating controls, and assessment of control coverage. • Assist stakeholders in understanding risk and control expectations, governance standards, and testing outcomes. • Offer guidance on data and AI governance best practices, including alignment to internal policies, standards, and risk frameworks. • Support proactive risk management efforts by identifying potential control weaknesses or governance gaps outside of formal testing cycles. • Lead and conduct walkthroughs with control owners and stakeholders to understand end-to-end processes related to in-scope control activities. • Document process flows, control descriptions, and key risks based on walkthroughs and artifact reviews. • Develop and maintain a working understanding of how data and AI controls operate within business and technology processes, enabling both testing and advisory activities. • Analyze and assess business and governance artifacts, including: Data governance policies, standards, and procedures Data lineage, metadata, and data quality documentation AI governance artifacts (e.g., model lifecycle documentation, approvals, monitoring evidence). • Evaluate whether artifacts sufficiently demonstrate control design, operating effectiveness, and risk mitigation. • Provide advisory feedback to stakeholders where artifacts or documentation do not fully support risk and control expectations. • Identify, document, and clearly articulate control deficiencies, design gaps, and operating issues, including root cause analysis. • Draft clear, risk-based issue descriptions and contribute to discussions on risk severity and impact. • Provide actionable, practical recommendations that balance risk mitigation with business and operational considerations. • Communicate testing results, risk insights, and advisory recommendations to stakeholders in a clear and professional manner. • Act as a primary testing and advisory contact for business partners, technology teams, and risk partners for assigned areas. • Partner with stakeholders to clarify control intent, evidence expectations, risk ownership, and remediation approaches. • Support ongoing governance forums, working groups, or risk discussions related to Data and AI governance. • Contribute to continuous improvement of Data & AI governance testing and advisory practices. • Create and maintain high-quality testing and advisory documentation, including workpapers, test scripts, walkthrough notes, risk assessments, and conclusions. • Ensure work meets quality standards, methodology requirements, and service level expectations while maintaining appropriate independence.
Job Requirements
- 3–5 years of relevant experience in control testing, risk management, audit, governance, or advisory functions.
- Demonstrated experience performing control design and operating effectiveness testing.
- Experience supporting or contributing to risk assessments and control evaluations.
- Strong analytical skills with the ability to interpret complex governance, risk, and technical artifacts.
- Strong written and verbal communication skills, including issue write-ups and advisory discussions.
- Required: CISA, CRISC or CGRC.
- Preferred: CDMP or AIGP
- Preferred Experience in Data Governance, AI Governance, Model Risk Management, or Technology Risk.
- Familiarity with data management concepts, AI/ML model lifecycles, and governance frameworks.
- Experience balancing independent testing responsibilities with advisory and consultative support.
Benefits
- Health insurance
- Tuition reimbursement
- Accident and life insurance
- Retirement savings plans
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
• Plan, create and execute manual tests. • Ensure the quality of outstanding applications. • Validate features and resolve issues with creativity. • Work collaboratively with a team passionate about innovation.
Role Description We are seeking an experienced QA Engineer to join our client’s team and play a critical role in ensuring the quality, reliability, and performance of our software products. This role is ideal for someone who enjoys automated testing while working in a fast-paced Agile environment. You will be responsible for designing and executing comprehensive testing strategies, building and maintaining automation frameworks, identifying and tracking defects, and collaborating closely with Development, Product, Support, and Engineering teams throughout the software development lifecycle. The ideal candidate has strong automation experience, thrives in rapidly evolving environments, embraces AI-assisted tooling, and is passionate about delivering high-quality software across web, mobile, and desktop applications. Responsibilities - Quality Assurance & Testing - Design, develop, and execute comprehensive test plans, test cases, and test scripts. - Perform manual and automated testing across web, mobile, and Windows desktop applications. - Execute functional, regression, integration, smoke, exploratory, compatibility, and performance testing activities. - Validate new features and enhancements against business and technical requirements. - Ensure software quality throughout the entire development lifecycle. - Test Automation - Design, build, maintain, and improve automated test frameworks and test suites. - Develop and execute automated tests using tools such as Ranorex, Mabl, Postman, Selenium, or similar platforms. - Expand automation coverage across critical workflows and business processes. - Integrate automated testing into CI/CD pipelines and release processes. - Leverage AI-powered testing tools and automation capabilities to improve testing efficiency and coverage. - Defect Management & Analysis - Identify, document, reproduce, and track software defects. - Collaborate with developers to investigate root causes and validate fixes. - Perform risk assessments and support defect prioritization efforts. - Participate in root cause analysis activities and recommend preventive actions. - Agile Collaboration - Work closely with Product Managers, Developers, Technical Support, and other stakeholders to ensure quality standards are met. - Participate in Agile ceremonies including sprint planning, backlog refinement, standups, retrospectives, and release planning. - Provide testing estimates, risk assessments, and release readiness recommendations. - Promote a shift-left testing culture and advocate for quality best practices. - Test Environments & Tools - Manage and maintain test environments, test data, and testing configurations. - Utilize Azure DevOps for test management, defect tracking, reporting, and collaboration. - Support testing activities in cloud and virtualized environments. - Maintain testing documentation and ensure traceability of testing efforts. - Customer & Production Support - Assist with the investigation and validation of customer-reported issues. - Work alongside Engineering and Support teams to diagnose production issues. - Verify fixes and support quality assurance activities for production releases. Qualifications - 6+ years of experience in Software Quality Assurance. - Strong experience with automated testing. - Experience testing: - Web applications - Mobile applications - Windows desktop applications - Hands-on experience with test automation tools such as: - Ranorex - Mabl - Postman - Selenium or similar frameworks - Experience building and maintaining automated test suites. - Experience working in Agile/Scrum development environments. - Experience using Azure DevOps for: - Test management - Defect tracking - Collaboration and reporting - Experience working in fast-paced software development environments. - Strong understanding of software testing methodologies and QA best practices. - Experience with CI/CD pipelines and automated testing integration. - Strong analytical, troubleshooting, and problem-solving skills. - Excellent written and verbal English communication skills. - Ability to work independently while collaborating effectively within distributed teams. Nice-to-Haves - Experience with AI-powered testing tools and AI-assisted QA workflows. - ISTQB, ISEB, or equivalent QA certification. - Experience with performance testing tools such as JMeter. - Experience testing cloud-hosted applications and virtualized environments. - Familiarity with accessibility testing, security testing, and compliance testing. - Experience in healthcare, dental, medical, or regulated software environments. - Experience working within globally distributed development teams. - Exposure to Azure cloud environments, VMware, or Hyper-V. - Continuous learning mindset with a passion for emerging QA technologies. Benefits - Work remotely Monday - Friday, 40 hours a week (no weekends). - Health Care Reimbursement. - Active Lifestyle Reimbursement. - Quarterly Home Office Reimbursement. - Payroll Deduction Purchase Plans. - Continuous Learning Bonus. - Access to Training and Professional Development Platforms.
• Building and customizing solutions on the Salesforce platform • Developing components, automations and integrations • Planning and executing tests • Quality assurance and validation of deliverables • Managing deployments and releases • Version control and pipelines • Change governance and environment stability
• Test planning and execution: Create detailed test plans, including strategies, test cases, and scripts, to ensure adequate coverage of requirements. Perform functional, regression, and integration testing, both manually and through automated tests. • Automated testing: Develop and execute automated tests using tools and frameworks such as Cypress, Selenium, Cucumber, JUnit, TestNG, or similar. Work closely with developers to ensure comprehensive test coverage and continuous integration into the development cycle. • Unit tests: Collaborate on creating unit tests to ensure code quality. Identify and report bugs and performance issues, and work with the team to resolve them efficiently. • Requirements analysis: Actively participate in the early stages of the development cycle by reviewing requirements and technical specifications. Identify potential issues or inconsistencies and provide recommendations for improvement. • Data analysis: Use SQL skills to run queries and analyze data in relational databases (SQL Server, MySQL, PostgreSQL). Validate the accuracy of processed data and ensure consistency of information across systems. • Teamwork: Collaborate closely with development team members and other stakeholders such as project managers, business analysts, and support teams. Attend meetings, provide status updates, and work together to improve testing and quality processes.
