Role Description We are seeking 3 Evaluation Analysts to assess the performance of AI models tasked with implementing web features. Your work directly informs whether AI-generated code is correct, whether the instructions given to the models are clear, and whether the testing frameworks used to evaluate them are fair and reliable. Core Responsibilities - Model Capability – Assess how well the AI performed each task by reviewing generated transcripts and results. - Bug Discovery Value – Identify patterns in AI code failures to understand why the model is making specific mistakes. - Score Health – Ensure tests are properly configured to apply correct scores during evaluation. - Task Specification Quality – Verify that prompts given to the AI are clear, correct, and technically precise (e.g., consistent variable names). - Test-by-Test Analysis – Evaluate the quality of automated tests using metrics like precision and recall to ensure they accurately measure AI performance. - Platform Issues – Report bugs or problems within the evaluation system itself, particularly with automated browser testing services. Qualifications - Expertise in finding patterns and issues in generative AI/LLM outputs - Direct experience with labeling and scoring frameworks - Experience writing Playwright tests - Strong analytical and problem-solving skills - Ability to interpret model behavior and articulate failure modes clearly Preferred Qualifications - Advanced analytical credentials — highly relevant for interpreting model behavior - Familiarity with web development concepts (HTML, CSS, JavaScript) - Experience with automated testing and grading systems - Background in quality assurance or evaluation methodology Requirements - Playwright Job Type & Location This is a Contract position based out of San Francisco, CA. Pay and Benefits The pay range for this position is $35.00 - $50.00/hr. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: - Medical, dental & vision - Critical Illness, Accident, and Hospital - 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available - Life Insurance (Voluntary Life & AD&D for the employee and dependents) - Short and long-term disability - Health Spending Account (HSA) - Transportation benefits - Employee Assistance Program - Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type This is a fully remote position. Application Deadline This position is anticipated to close on May 29, 2026.

Role Description We are hiring for one of our clients and are looking for a hands-on QA Automation Engineer with experience in automation testing and strong exposure to API automation. This role focuses heavily on writing, maintaining, and improving automation scripts and frameworks. The ideal candidate understands automation concepts and scripting logic — not just automation tools — and is comfortable working with APIs, debugging scripts, and enhancing existing automation solutions. This is a great opportunity for someone at a beginner-to-mid automation level who wants to grow in a highly practical automation-focused environment. - Write, maintain, and enhance automation scripts - Work extensively with API automation testing - Improve and support existing automation frameworks - Convert manual test cases into automated tests - Debug and troubleshoot automation issues - Execute automated test suites and support defect tracking - Collaborate with QA and development teams to improve test coverage and quality Qualifications - Hands-on experience with automation testing (UI and API) - Basic programming/scripting knowledge in Java or similar language - Strong understanding of automation concepts and testing logic - Experience with API automation and API testing workflows - Ability to read, understand, debug, and enhance automation scripts - Understanding of test execution, defect tracking, and QA processes - Strong analytical and problem-solving mindset - Ability to work methodically and collaboratively within a team environment Requirements - Experience with Playwright or Selenium (Nice to Have) - Experience with REST Assured or similar API automation libraries (Nice to Have) Company Description This Position is Sponsored by Sperton Global, a recruitment and consulting company with an international reach. We are committed to helping our clients achieve success in their hiring processes, finding the right people for the right positions.

• Deliver external and internal automation projects • Building automations which are delivered to time, budget and agreed specification • Accountable for quality of automations and client experience on aligned projects • Develop and share development best practice with customer, partners and rest of Blue Prism organization • Participation in new product release testing and enablement • Deliver client and partner Knowledge Share workshops • Lead and participate in User Acceptance Testing and defect resolution • Identification and development of internal automation opportunities • Potentially participating in multiple development projects simultaneously • Interact and participate in discussions shaping Cloud development Guidelines • Assist with support tickets where certain expertise/experience is required

• Build and maintain automation systems that streamline SEO and marketing operations. • Design repeatable workflows that reduce manual execution and improve scalability. • Leverage AI tools and agentic workflows to improve operational efficiency and execution speed. • Identify operational bottlenecks and proactively implement automation-driven solutions. • Continuously refine workflows to improve reliability, speed, and output quality. • Develop and maintain browser automation and web scraping workflows. • Work with APIs, structured datasets, and automation tooling to connect systems and improve data flow. • Troubleshoot and optimize workflows using programming logic and systems thinking. • Support Git/GitHub-based workflows and collaborate on technical implementations where required. • Operate independently with minimal oversight while managing multiple competing priorities. • Translate high-level goals into structured workflows and actionable execution plans.