• Own the evaluation stack. Design and build LLM-as-judge systems, calibrate them against human labels, and make agent quality measurable per-agent and per-failure-mode. • Make the release gate real. Build per-PR eval harnesses and regression detection wired into CI, so quality is enforced automatically, not by manual passes. • Build user simulators to generate test coverage and adversarial cases before real users hit them. • Turn production signal into improvement - pipe real failures back into evaluation sets so the system compounds over time. • Partner with product to turn "what good looks like" into concrete, measurable criteria. • Grow into agent development - contribute to building and hardening the agents themselves, starting with the components you know most deeply from evaluating them.

Role Description We are looking for someone who can handle system testing, end-user support, analysis, employee online services, etc. As a software tester at 5centsCDN, you will be responsible for testing a variety of software with the goal of reporting defects into a bug tracking database. - Understanding Software Requirements and User Stories. - Contributing to Test Plan Preparation. - Developing Test Scenarios/Outlines. - Documenting Test Cases. - Updating Traceability Matrices document. - Collecting Test Data. - Creating Test Batches. - Executing Test Cases. - Reporting Defects. - Tracking Defects. - Collect Test Metrics. - Selecting test cases for re- and regression testing. - Executing Regression Tests. - Modifying Test Cases (If Required). - Reviewing software requirements and preparing test scenarios. - Analyzing test results on database impacts, errors or bugs, and usability. - Participating in design reviews and providing input on requirements, product design, and potential problems. - Create business scenarios and finalize the same with business and IT stakeholders. - Analyze software issues to determine root causes and provide detailed reports or enhancement suggestions to the Account Manager and developers. - Remain up-to-date with testing technologies and methodologies, QA industry standards, principles, and practices. Qualifications - A bachelor's degree in computer science or related field is required. - Solid understanding of QA testing methodologies and practices. - Experience in collaborating with product and engineering teams to understand product requirements. - Familiar with HTML, XHTML, CSS, JavaScript. - Strong analytical and problem-solving skills, including root cause analysis and sound independent decision-making. - Solid understanding of the software project life cycle and associated methodologies. Requirements - We are looking for a doer, the type of person that brings a can-do, figure it out type of energy to the job every day, and is willing to jump in and help. Company Description Our CDN company is dedicated to providing A-grade services with their bandwidth pricing starting at 5 cents per GB. To move in, the clients don't have to make any commitments, sign any contracts, or pay for the setup. Currently, we are proudly serving 2000+ clients that consist of OTT, IPTV, ad agencies, gamers, government agencies, NGOs, and major TV channels. - Customers are enabled to access any of our 1200+ PoPs located across the globe. - Our integrated multi-CDN network allows you to connect to end users with minimum latency limited to the peering relationships of our partners. - The advanced, next-generation-centric services and network infrastructure not only help you to connect to your end-users within their ISPs themselves, but also ensures fast, secure, and affordable content delivery.

Role Description We are seeking an Accessibility Tester to support applications within the Office of Information Technology (OIT). The primary goal of this role is to ensure all OIT applications meet accessibility standards and deliver an inclusive user experience for individuals with disabilities. Project Goals - Identify accessibility issues across assigned OIT applications. - Ensure compliance with accessibility standards (WCAG 2.1 AA, Section 508). - Provide clear, actionable recommendations for remediation. Scope of Work - Perform comprehensive accessibility assessments, including: - Manual testing with assistive technologies (e.g., screen readers, keyboard-only navigation). - Automated testing using approved accessibility tools. - Reviewing design specifications and wireframes for accessibility considerations. - Reporting defects with detailed reproduction steps and recommended fixes. - Collaborating closely with development, business, and QA teams. - Participating in accessibility reviews, meetings, and trainings as needed. Deliverables - Accessibility test plans. - Detailed test reports outlining issues, severity, and recommendations. - Defect reports documented in OIT's designated tracking system. - Summary updates on accessibility findings and overall progress. - Documentation of accessibility best practices and guidelines, as requested. Responsibilities - Execute accessibility test cases thoroughly and accurately. - Follow the Accessibility Checklist for the Testing Team. - Document and communicate all findings clearly to stakeholders. - Provide guidance on remediation and accessibility best practices. - Stay current on accessibility standards and guidelines. - Meet all project timelines and adhere to OIT quality standards. Acceptance Criteria All deliverables will be reviewed and approved by OIT's designated representative to ensure they meet the required standards and expectations. The Accessibility Tester will report to Christine Coakley, Manager - Enterprise Applications, and will provide regular updates via SH weekly notes. Qualifications - Excellent written and verbal communication skills. - Strong understanding of OOP concepts. - Hands-on experience with API and Web Services Testing. - Solid knowledge of traceability matrices, test strategy, and test planning. - Familiarity with Agile and Jira processes. - Experience with platforms such as Java, Mobile/PWA, and Salesforce. Sample Duties - Perform hands-on testing. - Write detailed scenarios for releases and provide test estimates.

Role Description I have an opportunity for a "Guidewire Test Engineer" - (100% Remote). Job Role: Guidewire Test Engineer Location: 100% Remote Duration: 12 Months Must be: USC / GC Only Interview Process: Video interview Must Have: - Guidewire Certification - this is required, no way around it - Experience with end to end test planning (building entire test suites from scratch) - REST API testing skills (ability to mock inbound/outbound calls using API documentation, simulate payloads and create samples, create structured test suites in Postman or similar tool, extract test results, write simple tests) - SQL and XML is a must - Automation experience (might leverage some simple automation to build test data in short term, future-state is to build the automated test suite) - Domain: Insurance Qualifications - Guidewire Certification - Experience with end to end test planning - REST API testing skills - SQL and XML knowledge - Automation experience - Domain knowledge in Insurance Requirements - USC / GC Only - Video interview process Company Description Technical Recruiter: David Miller Contact: PH: 224-433-7876 | Email: david@navtechusa.com Company: NAVTECH INC