Transform your business and personal tasks with flexible resourcing solutions
AI Operations, QA Analyst
Location
Philippines
Posted
2 days ago
Salary
0
Seniority
Senior
Job Description
AI Operations, QA Analyst
Apply Minds
• Review AI-generated summaries, extracted data, classifications, and responses for accuracy and completeness • Compare AI outputs against original source documents and identify discrepancies • Validate information extracted from PDFs, scanned documents, forms, and structured datasets • Execute manual functional, regression, exploratory, and user acceptance testing (UAT) where required • Create, maintain, and execute structured test cases and test scenarios • Identify, document, and report defects with clear reproduction steps and supporting evidence • Verify defect fixes and perform regression testing before releases • Maintain QA trackers, validation logs, and testing documentation • Support document classification, data validation, and quality control activities • Review AI confidence scores and investigate low-confidence or inconsistent outputs • Escalate complex or high-risk cases to the appropriate stakeholders • Collaborate with Product, Engineering, and AI teams to improve system quality and performance • Contribute to improving testing processes, validation procedures, and QA documentation • Ensure deliverables meet quality, accuracy, and compliance standards
Job Requirements
- Excellent attention to detail and a methodical approach to work
- Strong written and verbal communication skills in English
- Experience in quality assurance, software testing, data validation, document review, or a related analytical role
- Ability to analyse information and identify inconsistencies or anomalies
- Experience using Microsoft Excel or Google Sheets
- Ability to follow structured processes, testing procedures, and documentation standards
- Strong organisational and time-management skills
- Comfortable working with large volumes of documentation and digital platforms
- Ability to work independently in a remote environment while collaborating effectively with distributed teams
- Technical Skills Experience with one or more of the following is advantageous: Microsoft Excel or Google Sheets Jira, Azure DevOps, or similar issue tracking tools Microsoft Office or Google Workspace AI platforms such as ChatGPT, Claude, Gemini, Microsoft Copilot, or similar Browser Developer Tools Test management tools and QA documentation platforms
Benefits
- Remote work opportunities that allow contributors to work from anywhere
- Professional development opportunities
- Support services for a diverse range of clients across industries
Related Guides
Related Categories
Related Job Pages
More QA Engineer Jobs
• Own the maintenance, organization, review cycle, and development of TimelyCare policies, procedures, practice guidelines, and related QA documentation. • Track policy review timelines, outstanding revisions, approvals, and version control to support continuous readiness. • Works with the training department to create and implement training material as needed to aid in educating employees and providers on policies, procedures, and practice guidelines. • Communicates and presents information effectively to groups and/or individuals with all levels of staff and leadership. • Collects and manages data essential for measuring improvement. • Prepares committee background materials, agendas, memos, minutes, and reports for the Quality Assurance / Quality Improvement Committee as directed. • Provides feedback and support for each service line to assist in maintaining a state of continuous readiness for visits/surveys/investigations conducted by external agencies (e.g. URAC, NCQA, etc.). • Performs assessments of quality related issues and risks. • Support root cause analysis efforts and help monitor action plans related to quality events, complaints, incidents, or identified gaps. • Participates in internal and external audits and inspections. • Partners with management teams to align compliance with the company's objectives. • Acts as a role model for excellence in care and shows a high degree of professionalism. • Participates in multidisciplinary project activities. • Attends and participates in meetings with management staff as requested. • Assists the QA Program Manager in preparing for regulatory surveys by instructing staff on matters of compliance and licensure, and immediately correcting problems noted by surveyors. • Assists QA Program Manager in preparing and documenting actions related to the Quality Assurance / Quality Improvement Committee.
Portuguese Accessibility Tester
Welo GlobalWelo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries. At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Role Description Welocalize is expanding its network of accessibility testers to validate the language-specific accessibility of localized digital content: web pages, applications, and documents. You will serve as a native-language expert reviewer, confirming that accessibility elements not only survive translation but are accurate, understandable, and functional in the target language. This role requires fluency in the target language, hands-on experience with assistive technology in that language, and familiarity with Digital Accessibility standards and guidelines such as PDF/UA, WCAG 2.1 & 2.2, and EN 301 549 to complement accessibility testing done internally. Work is assigned on a project basis. You will receive a defined scope, a testing checklist, and access credentials. Findings are reported in a structured defect log and specific bug tracking system. What You Will Do - Language Validation : Confirm correct language codes in HTML and PDF metadata, and identify mixed-language content missing proper declarations. - In-Language Screen Reader Testing : Using native-language screen readers (JAWS, NVDA, VoiceOver, TalkBack, or Narrator), review translated accessible text — including hidden elements, tooltips, error messages, alt text, and UI labels — for accuracy, natural phrasing, and clarity when read aloud. - Multimedia Accessibility Review : Evaluate captions, transcripts, and audio descriptions for accuracy, synchronization, and natural language, and confirm multimedia controls are properly labeled in the target language. - Defect Reporting : Log findings with WCAG/PDF-UA references, supporting screenshots or recordings, and severity classifications; participate in review calls with the QA Lead as needed. Qualifications - Native or near-native fluency in Portuguese; you are the authoritative voice on whether translated content reads naturally and is understandable. - Demonstrated hands-on experience testing digital content with assistive technology/AT. - Working knowledge of WCAG 2.1 & 2.2 AA and EN 301 549. - Ability to evaluate content from a native-speaker accessibility perspective — not just technical compliance, but real-world usability for screen reader users who speak the language. - Reliable access to relevant devices and operating systems to replicate real-world usage in the target locale. Requirements - Nice to have : Strong written communication skills in English for defect reporting and general communications. - Experience with PDF accessibility testing using PAC 3 or Adobe Acrobat Pro Accessibility Checker. - Familiarity with internationalization, localization, and translation workflows; understanding of how accessibility elements can be affected during format conversion. - Personal use of assistive technology. Tools and Environment Welocalize provides access credentials and a structured test plan per engagement. Testers are expected to supply their own device and assistive technology setup appropriate to the target locale. Commonly used tools in this role include: - Screen readers : JAWS, NVDA, VoiceOver (macOS/iOS), TalkBack (Android), Narrator (Windows) - Browser/screen reader pairings : aligned to the target locale's most common usage patterns - Caption and transcript review : native video players, .srt/.vtt file review - PDF accessibility : PAC 3, Adobe Acrobat Pro (provided where required) - Defect logging : Jira bug tracking system is most frequently used What to Expect Assignments are project-based with clear scope documents, test checklists, and agreed turnaround timelines provided before work begins. Scope for each engagement will specify the exact language, content type, pages or documents in scope, and priority areas. You will not be expected to remediate or fix issues; your role is testing and reporting. Welocalize values feedback: if checklist items are unclear or a finding falls outside the defined scope, flag it and we will address it. How to Apply Click on the Apply Now button and share with us the following: - A brief introduction covering your language, screen reader experience, and accessibility background. - Any relevant certifications (CPACC, WAS, DHS Trusted Tester, or equivalent). We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Associate Software Quality Engineer
ServiceNowAs the AI platform for business transformation, we're putting AI to work across organizations — freeing people for work that matters. Making old tech work with new tech. Reaching across departments, from the front office to the back office and every office in between. Our ambition? To become the AI defining enterprise software company of the 21st century (or "AI DESCO21C," as we like to call it). With more than 8,400+ customers, we serve approximately 90% of the Fortune 500®, and we're proud to be a Fortune 100 Best Companies to Work For® and World's Most Admired Companies™. Explore your future career with us, visit www.careers.servicenow.com From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.
• Maintain existing automation test frameworks • Collect and report quality metrics from test execution • Work with developers to design testing strategies for features • Create and automate comprehensive test plans • Support engineering organizations in troubleshooting issues
Quality Assurance Analyst
Raphael & AssociatesThird Party Claims Administrators and Independent Insurance Adjusters
• Support the ongoing development, maintenance, and enhancement of the organization’s internal auditing platform, including identifying system improvements, testing updates, and optimizing audit workflows. • Conduct comprehensive audits of claim examiners to evaluate adherence to company policies, quality standards, and applicable regulatory requirements, while identifying areas of risk and opportunities for improvement. • Serve as a primary liaison between clients, third-party vendors, and internal stakeholders to coordinate external audit activities, ensuring timely communication and efficient audit execution. • Collect, review, organize, and submit audit-related documentation to support external audits, ensuring accuracy, completeness, and compliance with established requirements. • Collaborate with cross-functional teams to analyze operational processes, identify opportunities for increased efficiency and compliance, and assist in developing and documenting standardized procedures and best practices. • Partner with Training, Legal, and Human Resources departments on special projects, compliance initiatives, policy implementation efforts, and other organizational priorities to support regulatory and business objectives.



