Role Description CMS & Web Platform Testing - Design and execute test cases for WordPress and Drupal-based web properties including provider websites, service line pages, microsites, and patient acquisition landing pages. - Validate content rendering, page templates, navigation, forms, and CTA flows across environments (dev, staging, production). - Test Drupal modules and WordPress plugins including SEO tools, form builders, content scheduling, and user role/permission configurations. - Perform regression testing after CMS upgrades, plugin/module updates, and theme changes. Automation - Build and maintain automated test suites using testRigor, Katalon Studio, Selenium, or Cypress for CMS-driven web workflows. - Automate regression coverage for high-frequency campaign pages and recurring content template validations. - Integrate automated tests into CI/CD pipelines (GitHub Actions, Jenkins, or CircleCI). Campaign & API Testing - Test service line campaign landing pages for functional accuracy, form integrations, lead capture workflows, and tracking pixel behavior. - Validate API integrations between CMS platforms and downstream marketing tools (CRM connectors, HRA platforms, analytics layers). - Execute cross-browser and mobile responsive testing to ensure consistent patient-facing experiences across devices. Collaboration & Reporting - Partner with developers, content strategists, and UX teams to clarify requirements and define acceptance criteria. - Log and track defects clearly in JIRA with reproducible steps and environment context. - Participate in Agile sprints - stand-ups, sprint planning, demos, and retrospectives. - Maintain test plans, test case libraries, and QA documentation in Confluence or similar. Qualifications - 6 years of QA/software testing experience, with at least 5 years in test automation. - Hands-on experience with WordPress - themes, plugins (Yoast, Gravity Forms, WPBakery/Elementor, ACF), content types, user roles, and multisite configurations. - Hands-on experience with Drupal - modules, content types, views, workflows, and admin interface testing. - Proficiency with testRigor, Katalon Studio, Selenium WebDriver, or Cypress for web automation. - Experience writing and executing structured test plans, test cases, and defect reports. - API testing experience using Postman, REST Assured, or similar tools. - Cross-browser and mobile responsive testing across Chrome, Firefox, Safari, Edge. - Familiarity with Agile/Scrum delivery and JIRA-based defect management. - Strong communication skills and ability to work in a fast-paced, multi-client agency environment.

Role Description We are sharing a specialised full-time consulting opportunity for experienced QA and test engineers with strong expertise in test-case design, end-to-end debugging, quality assurance, Python, and complex technical evaluation workflows. This role supports the development of advanced agentic evaluation benchmarks for frontier AI models. Selected professionals will review complex multi-step tasks, test reference solutions, identify ambiguity and grading gaps, debug technical environments, and develop repeatable quality processes that keep benchmark results accurate and trustworthy. Key Responsibilities - Test Case Design - Create comprehensive test cases confirming that benchmark tasks function as intended - Design positive, negative, boundary, and edge-case tests - Validate task requirements, expected outputs, reference solutions, and grading logic - Identify scenarios that may produce incorrect or misleading evaluation results - Ensure tests measure the intended technical capability accurately - Benchmark Task Review - Review complex multi-step tasks and reference solutions before finalisation - Identify ambiguous instructions, inconsistent requirements, missing assumptions, and incomplete acceptance criteria - Run tasks independently to confirm reproducibility and expected behaviour - Assess whether grading standards are clear, fair, and technically defensible - Provide actionable feedback to task authors and researchers - Technical Debugging - Investigate failures across Python scripts, test harnesses, repositories, and task environments - Diagnose unexpected behaviour within unfamiliar codebases - Reproduce reported issues and isolate their underlying causes - Correct or document environment, dependency, logic, and validation problems - Use Git-based workflows to support structured review and collaboration - Quality Process Development - Develop practical checklists and repeatable review procedures for benchmark quality - Improve consistency across task validation, testing, and approval workflows - Document findings clearly so authors can resolve issues efficiently - Track recurring defects and recommend preventive quality measures - Collaborate closely with researchers, task authors, and other technical reviewers - Benchmark Integrity & Shortcut Detection - Examine AI agent runs for unintended shortcuts, loopholes, and grading weaknesses - Identify cases where models can receive credit without completing the intended reasoning or technical work - Test whether benchmark tasks remain robust across alternative approaches - Strengthen evaluation criteria to maintain reliable and meaningful benchmark scores - Distinguish valid solution diversity from unintended task exploitation Qualifications - At least 1 year of experience in test engineering, quality assurance, software engineering, research engineering, or a related technical role - Demonstrated experience designing test cases and quality-review processes - Strong end-to-end debugging skills across complex technical systems - Working proficiency in Python and Git - Comfort navigating unfamiliar codebases, repositories, and execution environments - Exceptional attention to detail and strong written documentation habits - Ability to identify ambiguity, edge cases, hidden assumptions, and quality gaps - Capacity to work independently through open-ended technical problems - Reliable availability for approximately 35 hours per week Requirements - A master's degree or PhD in a STEM field is highly relevant - Equivalent practical experience in an engineering-intensive or research-intensive domain may also be considered - Academic or professional experience involving computer science, software engineering, machine learning, mathematics, statistics, or a related technical field may strengthen an application - Technical research, open-source contributions, testing projects, or substantial engineering work may also be valuable Nice to Have - Experience with AI training, model evaluation, or quality review of AI-generated work - Familiarity with agentic systems and multi-step AI benchmarks - Background testing machine learning, research, or data-processing workflows - Experience developing automated test suites or validation scripts - Familiarity with CI/CD systems, test harnesses, containers, or reproducible environments - Experience reviewing reference solutions, grading logic, or technical rubrics - Knowledge of adversarial testing, failure-mode analysis, or benchmark design - Prior collaboration with AI research or evaluation teams Why This Opportunity - Serve as the quality backbone for advanced agentic AI benchmarks - Ensure complex evaluation tasks are accurate, reproducible, and resistant to shortcuts - Apply testing and debugging expertise to technically challenging AI research workflows - Work closely with researchers and task authors on benchmark improvement - Help protect the reliability of evaluation results for frontier AI systems - Participate in a structured full-time remote role with competitive hourly compensation Contract Details - Full-time W-2 contingent employment opportunity - Fully remote within the United States - Expected commitment of approximately 35 hours per week - Competitive rates between $55–$85 per hour depending on expertise and project scope - Individual task reviews may require one to two days of focused technical work - Work may include test design, benchmark review, Python debugging, quality-process development, and shortcut detection - Close collaboration with research and task-development teams - Engagement scope and duration may evolve according to project requirements and performance About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

Role Description As a Quality Assurance & Compliance Specialist at Gainwell, you will support quality assurance, contract compliance, and governance activities for the Wisconsin Medicaid Management Information System (MMIS) contract. You will partner with account and functional leaders to evaluate operational performance, identify quality and compliance risks, and drive improvements that support contractual requirements and service excellence. This role is ideal for a detail-oriented and collaborative quality professional who can analyze complex information, facilitate discussions, identify root causes, and translate findings into meaningful improvements. - Analyze objective and subjective evidence to assess quality, identify root causes, recognize performance trends, and provide actionable feedback that supports training and process improvement. - Serve as a subject matter expert and escalation resource for complex or high-risk quality issues, facilitating calibration and standardized evaluation practices across operational teams. - Partner with leaders and staff to maintain and improve incident reporting, standard operating procedures (SOPs), corrective action plans, and other quality processes that support consistent execution. - Evaluate compliance with policies, contractual requirements, service level agreements, laws, and regulations; identify gaps and recommend appropriate corrective actions. - Develop formal reports and communicate quality, audit, compliance, and performance findings to leadership while monitoring changes to Wisconsin MMIS contract requirements. Qualifications - Bachelor’s degree or equivalent combination of education and relevant experience. - Three or more years of experience in quality assurance, contract compliance, operational quality, audit, or a related function; healthcare or insurance industry experience preferred. - Experience applying audit concepts, practices, and procedures, with the ability to analyze findings, identify root causes, evaluate compliance, and recommend corrective actions. - Experience working with business applications, operating systems, relational databases, and technology supporting contact center or back-office operations; experience with Verint and CXone is a plus. - Strong analytical, problem-solving, communication, facilitation, and organizational skills, with experience managing multiple priorities, supporting change initiatives, and driving quality improvements. Requirements - Remote work environment requiring the ability to work independently while collaborating closely with account leaders, functional teams, and other business partners. - Regular involvement in quality assurance, contract compliance, governance, audit, and continuous improvement activities supporting the Wisconsin MMIS account. - Responsibility for handling sensitive and confidential information with appropriate discretion and professionalism. - Fast-paced work requiring strong attention to detail, sound judgment, adaptability, and the ability to prioritize multiple quality and compliance initiatives. - Opportunity to influence operational performance by identifying risks, improving processes, strengthening compliance, and helping teams consistently meet contractual and quality expectations. Benefits - Generous, flexible vacation policy. - 401(k) employer match. - Comprehensive health benefits. - Educational assistance. - Variety of leadership and technical development academies to help build your skills and capabilities.

Role Description As a Business Process Quality Assistant, you will support the Tech and Process Architect in ensuring that company processes are properly followed, documented, and continuously improved. You'll act as the first line of process policing — monitoring adherence, receiving and documenting feedback, and keeping all process documentation updated and accurate. Your role ensures that every department operates in alignment with defined procedures and that opportunities for improvement are consistently captured and escalated for review. Key Responsibilities - Process Auditing and Compliance - Regularly review and monitor department operations to ensure adherence to documented processes. - Identify process gaps, inconsistencies, or non-compliance and record them clearly. - Conduct periodic spot checks and audits as scheduled. - Feedback and Escalation - Serve as the first receiver of feedback regarding processes, whether from staff, leaders, or clients. - Organize and categorize feedback for easy tracking and resolution. - Escalate findings and recommendations to the Tech and Process Architect for evaluation and action. - Process Documentation - Maintain and update the company's process documentation and archives. - Assist in creating, formatting, and finalizing SOPs, process maps, and related materials. - Ensure version control and accessibility of all official process documents. - Reporting and Support - Prepare regular reports summarizing audit results, feedback received, and areas for improvement. - Coordinate with department heads to clarify procedures and collect necessary data. - Support the Tech and Process Architect during process reviews, trainings, and quarterly evaluations. What Success Looks Like - Processes across departments are clearly documented and consistently followed. - Feedback and findings are well-organized and easily traceable. - The Tech and Process Architect receives accurate reports that inform decision-making. - Departments see increased compliance and smoother internal operations. Onboarding and Integration During your first few weeks, you'll: - Attend New Hire Orientation and Leadership Introductions. - Review the Accountability Chart, Department Deliverables, and Core Processes. - Shadow operations to understand daily workflows. - Begin documenting observations and process flow notes. - Assist in creating the Quality Audit schedule. - Support quarterly and other scheduled reviews and reporting activities. Qualifications - Extensive Knowledge of ClickUp - Able to create builds or learn how to build workflows - Can troubleshoot ClickUp related issues - Has experience documenting processes - Has experience with creating visual mind maps/workflows - Has tech support experience Requirements - MUST BE A FILIPINO RESIDING IN THE PHILIPPINES. - Location: REMOTE-WFH Cebu City, Cebu, Philippines - Schedule: Full-time, amenable to work in US time zones - Start Date: Immediate Benefits - 100% Work-from-Home Setup - Employment Regularization After 6 Months - PH Government Mandated Benefits (SSS, Pag-IBIG, PhilHealth) - 13th Month Pay - HMO Life and Health Coverage - 20% Night Premium Pay - Paid Sick and Vacation Leaves Company Description At Open Look Business Solutions Inc. - 032 Outsourcing, we believe that great teams build great businesses. Guided by our core values Positivity, Integrity, Tenacity, Dependability, and Belief, we are committed to helping our clients grow while creating rewarding careers for our people.