• Design, develop, and execute test plans, test scenarios, and test cases for banking applications. • Perform **functional, regression, integration, system, and User Acceptance Testing (UAT)** to validate application functionality. • Test and validate **Temenos T24** core banking modules, with emphasis on mortgage and lending products where applicable. • Verify end-to-end banking workflows, business processes, and system integrations across multiple applications. • Conduct API testing and backend data validation to ensure data accuracy and system integrity. • Validate BPMN/workflow-based processes and ensure seamless workflow execution. • Collaborate with Business Analysts and Product Owners to understand business requirements and translate them into effective test scenarios. • Identify, log, track, and verify software defects through resolution using defect management tools. • Participate in Agile ceremonies including sprint planning, daily stand-ups, backlog refinement, sprint reviews, and retrospectives. • Support CI/CD and DevOps initiatives by participating in continuous testing activities. • Work closely with development teams to improve product quality and reduce production defects. • Prepare test execution reports, quality metrics, and provide timely updates to project stakeholders. • Support production releases and perform post-deployment validation when required. • Ensure compliance with organizational quality standards and banking regulatory requirements.

• Execute end-to-end functional and migration testing for Temenos T24 **LD to AA Loans Migration** projects. • Validate migration of conventional loan products (Working Capital Loans, Bonds, Housing Loans/Grants) and Islamic financing products (Ijarah and Murabaha) into the AA module. • Verify complete loan lifecycle functionality, including origination, disbursement, repayment schedules, accruals, charges, penalties, restructures, settlements, and loan closure. • Perform detailed reconciliation between legacy LD contracts and migrated AA arrangements, ensuring accurate migration of principal, accrued interest/profit, due amounts, penalties, charges, repayment schedules, and portfolio balances. • Validate Oracle General Ledger (GL) reconciliation to ensure financial postings and accounting entries are accurate after migration. • Test digital banking integrations, including loan enquiry, repayments, Direct Debit (DDS), and BPM workflow integrations. • Design and execute migration test cases using migration strategy documents, mapping sheets, BRDs, and production-like test data. • Validate extraction, transformation, data loading, and post-load reconciliation across multiple migration and dress rehearsal cycles. • Identify, analyse, document, and track defects, perform root cause analysis, and support defect resolution throughout the migration lifecycle. • Support cutover activities, Go/No-Go validation, rollback verification, and production readiness. • Prepare detailed test execution reports, reconciliation summaries, and migration validation results. • Mentor junior QA engineers and contribute to testing best practices, quality standards, and continuous process improvements.

• Design and implement automated test frameworks for web and API testing • Develop and maintain regression, smoke, and integration test suites • Integrate automated tests into CI/CD pipelines • Identify, document, and track software defects • Collaborate with developers to improve testability and quality standards • Perform API testing and validate data integrity • Improve testing efficiency and reduce manual testing effort • Participate in release validation and production support

• Create comprehensive test cases confirming that benchmark tasks function as intended • Design positive, negative, boundary, and edge-case tests • Validate task requirements, expected outputs, reference solutions, and grading logic • Identify scenarios that may produce incorrect or misleading evaluation results • Ensure tests measure the intended technical capability accurately • Review complex multi-step tasks and reference solutions before finalisation • Identify ambiguous instructions, inconsistent requirements, missing assumptions, and incomplete acceptance criteria • Run tasks independently to confirm reproducibility and expected behaviour • Assess whether grading standards are clear, fair, and technically defensible • Provide actionable feedback to task authors and researchers • Investigate failures across Python scripts, test harnesses, repositories, and task environments • Diagnose unexpected behaviour within unfamiliar codebases • Reproduce reported issues and isolate their underlying causes • Correct or document environment, dependency, logic, and validation problems • Use Git-based workflows to support structured review and collaboration • Develop practical checklists and repeatable review procedures for benchmark quality • Improve consistency across task validation, testing, and approval workflows • Document findings clearly so authors can resolve issues efficiently • Track recurring defects and recommend preventive quality measures • Collaborate closely with researchers, task authors, and other technical reviewers • Examine AI agent runs for unintended shortcuts, loopholes, and grading weaknesses • Identify cases where models can receive credit without completing the intended reasoning or technical work • Test whether benchmark tasks remain robust across alternative approaches • Strengthen evaluation criteria to maintain reliable and meaningful benchmark scores • Distinguish valid solution diversity from unintended task exploitation