Software Mind logo
Software Mind

Software House focused on results since 1999

Senior QA Automation Engineer, AI Systems

SDETSDETFull TimeRemoteSeniorTeam 1,001-5,000Since 1999H1B No SponsorCompany SiteLinkedIn

Location

Qatar

Posted

8 days ago

Salary

0

Seniority

Senior

6 yrs expEnglishPython

Job Description

Senior QA Automation Engineer, AI Systems

Software Mind

• Design and implement the validation harness for RAG output quality: retrieval accuracy, citation correctness, and grounding • Build automated test suites for the AI Extraction Gateway across Simple RAG and Complex RAG implementations • Develop and execute accuracy rubric test cases in collaboration with the BA and Designated Subject Matter Expert • Automate regression testing for confidence score calibration and source weighting behaviour • Test RBAC enforcement and role-specific filtered view access controls • Validate audit logging completeness and document lifecycle traceability • Build and maintain the incremental ingestion pipeline test suite • Contribute to go/no-go decision packs: produce accuracy reports and test evidence documentation

Job Requirements

  • 6+ years in QA automation engineering; senior seniority required
  • Strong test automation engineering skills
  • Python preferred (pytest or equivalent framework)
  • Experience with API testing and contract testing
  • Comfortable designing test frameworks for non-deterministic or probabilistic systems
  • Experience in agile/scrum environments with Jira-based test management

Benefits

  • Flexible work arrangements

Related Categories

Related Job Pages

More SDET Jobs

Worth AI logo

Software Development Engineer – Test

Worth AI

AI Data-Driven Credit Score For Every Business 💸✨

SDET8 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Design, develop, and maintain automated test scripts and frameworks to ensure high-quality software delivery. • Develop robust testing strategies for both back-end and front-end components of our applications. • Collaborate with cross-functional teams to understand requirements and provide testing insights throughout the development lifecycle. • Execute functional, regression, and performance testing to identify software defects and ensure optimal functionality. • Utilize tools and technologies to enhance automated testing capabilities. • Identify and report defects, track issues, and work closely with developers to resolve them efficiently. • Participate in code reviews, providing feedback on testability and quality aspects of code. • Maintain testing documentation, including test plans, test cases, and technical specifications. • Research and implement industry best practices for software testing and automation. • Assist in performance testing and analyze results to identify areas for improvement.

Florida
Full TimeRemoteTeam 10,001+Since 1990H1B No Sponsor

• Design, orchestrate, and validate the automated verification systems for AI-First Software Development Lifecycle. • Operate within an AI-First SDLC, providing test strategy and quality accountability. • Design, build, and maintain AI agent workflows for various test suites from specifications. • Construct and maintain test context for agents to provide correct test outputs. • Support independent QA verification and contribute to system testing in production-like environments. • Collaborate with cross-functional teams to translate business requirements into validation workflows.

United States
Absolute Software logo

Associate Software Test Engineer

Absolute Software

Absolute Software is a publicly traded, global provider of self-healing endpoint security and IT asset management solutions for the protection of data, applications, devices, and u

SDET8 days ago

Role Description We’re looking for an Associate Software Test Engineer who’s eager to grow, hungry to learn, and excited to be part of a collaborative, agile team. If you're the kind of person who can sniff out a bug from a mile away and finds joy in uncovering what breaks (and why), you’ll fit right in. This is a remote role focused on the Victoria, BC region—where we have a handful of awesome teammates you might collaborate with from time to time. What You’ll Do - Following detailed test plans and test cases to verify product features and functionality. - Reading and reviewing user stories to understand expected behavior and help identify edge cases. - Collaborating with developers, product owners, and other testers to ensure stories are testable and well-defined. - Helping flesh out test cases for new or evolving features, with opportunities to contribute your own. - Running manual and automated tests on our VPN client/server applications across a variety of environments—virtual and physical, wired and wireless. - Testing across multiple platforms: Windows, Android, MacOS, and iOS, often within VMWare and Azure cloud environments. - Reporting issues, verifying fixes, and being the voice of quality. - Spotting opportunities for automation and jumping on them. - Creating, improving, or tweaking internal test tools that make everyone’s life easier. - Protect the security and privacy of Absolute and its customers. - Other duties as assigned by management. Qualifications - A degree in Computer Science or another STEM field. - Internship or 1 year of hands-on software testing experience (bonus if it involved client/server or mobile testing!). - Familiarity with Azure cloud environments (and a willingness to learn more). - Solid networking know-how and troubleshooting chops (Windows or Linux). - Exposure to tools like Wireshark or NetMon. - Some experience or curiosity about test automation (Python, Selenium, C#? Even better). - An interest in setting up test environments using Docker and Kubernetes. - Self-motivated, with the ability to work both independently and as a collaborative team member. - Strong analytical skills and excellent organizational habits—you like things tidy, trackable, and clear. - Quick learner with an eye for detail and a drive to make things better. - A communicator, collaborator, and all-around quality advocate. - A natural instinct to break things—and break them well. Nice-to-have skills - Performance testing experience. - Familiarity with MDMs (Mobile Device Management). - Knowledge or experience with AI tools—especially in the context of development, testing, or boosting personal/team efficiency. - Being bilingual—Japanese, French, Italian, German, Spanish, or Portuguese is great! Benefits - The base pay range for this position is from CAD $61,200 – CAD $72,000 annually; the base pay offered is determined by the market location and may vary depending on job-related knowledge, skills, experience, and internal equity. - As part of our total rewards offering, permanent employees in this position may be eligible for our annual bonus program. Company Description Headquartered in Seattle, Washington with international offices in Vancouver - BC, Austin - TX, Boulder - CO, Ankeny – IA, Reading - UK and Ho Chi Minh City – Vietnam, Absolute Security accelerates customers’ shift to work-from-anywhere through the industry’s first self-healing Zero Trust platform, ensuring maximum security and uncompromised productivity. Our vision is to be the world’s most trusted security company – and to empower end users to connect securely and from anywhere, to all the applications they need to collaborate and get their work done, without interruptions and with an optimal network experience.

United States + 1 moreAll locations: United States | Canada
C$61.2K - C$72K / year
Qualitest Group logo

Test Engineer

Qualitest Group

Qualitest Group is a global engineering company whose services and expertise are powered by artificial intelligence. Qualitest Group helps businesses reach thei

SDET8 days ago

Role Description We are seeking an Automation Engineer with experience in test automation and financial services applications. In this role, you will support the testing of banking platforms, including Fiserv DNA, while leveraging AccelQ to build and execute automated test solutions. Location: Remote (United States) Employment Type: Full-Time | Permanent Key Responsibilities - Design, develop, and execute functional, integration, and regression test cases. - Create and maintain automated test scripts using AccelQ. - Validate banking workflows, including accounts, payments, lending, and transactions. - Perform API and database testing as needed. - Identify, document, and track defects using Jira. - Collaborate with cross-functional teams in an Agile environment. Qualifications - Experience with AccelQ test automation. - Knowledge of banking, financial services, or fintech applications. - Strong understanding of Software Testing Life Cycle (STLC) and end-to-end testing. - Experience with functional, regression, and integration testing. - Familiarity with Jira and defect management processes. - Strong analytical and communication skills. Requirements - AccelQ Test Automation - Financial Services Domain Experience - End-to-End Testing & QA Processes Benefits - Be a part of a company that strives to support diversity and inclusion in the workplace. - Local and global opportunities for internal rotation and international mobility. - Clear view of your career and progression with the company. - Flexible and casual culture with employee events and amenities. - 401k plan with company match. - Competitive healthcare benefits with HSA matching. - Learning & Development platform: 50,000+ courses and mentorship programs. - Corporate Wellness Program with gym membership reimbursement. - Bonuses via Client Referral and Employee Referral Programs. - Recognition through the Qudos platform for achievements. - Access to Qualitest Employee Perks for discounts on travel and electronics. - Competitive pay, with a salary range of $100,000–$110,000 per annum.

United States
$100K - $110K / year