• Oversee the end-to-end strategy, development, and quality assurance of AP Reading publications. • Direct the annual planning and execution of AP post-administration publication templates, schedules, and deliverables. • Drive the strategic transformation of AP Reading publication delivery. • Architect and manage scoring guideline templates for AP Reading, AP Central, and AP Classroom. • Lead the coordination and execution of spring scoring guideline reviews across all subjects and exam forms. • Partner with the Publications team and external vendors to optimize tools, processes, and timelines for the annual export and integration of free-response scoring assets. • Ensure AP assessment team compliance with IACET CEU accreditation standards. • Champion innovation by leading pilot projects and strategic initiatives. • Strategize and implement enterprise-wide scheduling and performance tracking systems. • Oversee the configuration, validation, and quality assurance of annual scoring systems and applications. • Evaluate cross-subject free-response performance data. • Engineer advanced scoring Smartsheets for central planning workbooks for the AP Reading. • Lead the management of the annual AP C&A Reading risk and escalation log. • Facilitate annual retrospective data collection and analysis with assessment content teams. • Quantify and communicate the effectiveness of AP Reading preparation and training efforts through data-driven impact reporting.

Pickford is building the next generation of storytelling. We're building expressive interactive narratives, while preserving storytelling's historical foundation as a tight loop between audience and creator. Our focus story quality and audience engagement means we get to work with truly exceptional creators. Our AI expertise has attracted world-class researchers. Together we're defining a new category of media. All of this comes together in a UGC platform where creators can build, share, and collaborate on living stories which can only be powered by AI. Position Overview: We’re looking for a contract QA engineer who understands that many of the hardest bugs don’t show up in automation. In this role, you’ll focus on hands-on, experiential testing of a real-time interactive product, running scenarios repeatedly, probing edge cases, and catching qualitative issues that only emerge during extended or realistic use. You’ll work closely with engineers, product, and creative to help define what “working correctly” means from a user’s point of view. This is a great fit for someone who enjoys thoughtfully breaking systems, cares about user experience, and can translate messy behavior into clear, actionable bug reports. Estimated weekly commitment is 2-3 days, initially, with a strong path toward full-time employment. Rates vary between $35-40/hr depending on experience. Key Responsibilities: - Manually test live interactive experiences, focusing on core user flows, session continuity, and state consistency - Identify qualitative issues related to pacing, responsiveness, clarity, and overall experience, not just crashes - Write clear, concise bug reports with reliable repro steps and expected vs actual behavior - Help define and protect a small set of critical “must-not-break” flows - Collaborate with engineers to verify fixes and prevent regressions - Contribute to lightweight regression testing and smoke test plans - Assist with or suggest areas for basic automation or tooling improvements

Role Description As an Ads Quality Rater, you will review and grade internet advertisements to help shape how ads are delivered to the end users. In other words, you’ll tell the AI program how good or bad its advertisement suggestions are based on the user’s keywords. You will review ads in both English and Lithuanian. This role is great for people who: - Surf the internet daily - Use major search engines frequently - Know what people want based on a few keywords - Enjoy researching topics online - Want a flexible and fun side job Qualifications - Fluency in Lithuanian - Strong understanding of English (written and spoken) - Comfortable knowledge of modern popular culture - Reliable computer system and internet connection - Familiar with using online search engines - Sign a standard Non-Disclosure Agreement and Service Level Agreement Requirements - This work is based on project needs. Due to this, weekly hours may vary and flexibility with change is expected. - You must legally be able to work on freelance projects in Lithuania. Benefits - Pay Rate: Based on tasks (approximately $7 per hour) - Location: Remote/work from home - must be based in Lithuania - Hours: Set your schedule based on the following – Minimum commitment is 5 hours per week. You can choose to work up to 20 hours per week. - Start Date: ASAP - Employment Type: Independent Contractor/Freelance/Self-Employed - Project Duration: Long-term Company Description Join our team at Welo Data and embark on a journey of growth and innovation.

• The Director of Quality Assurance (QA) Systems is responsible for ensuring the validation, integrity, and compliance of systems across Precision for Medicine (PFM) • Oversees the development, implementation, and maintenance of QA strategies and processes that support regulatory requirements, industry standards, and internal policies • Leads cross-functional teams to ensure systems are validated, documented, and maintained in a state of control • Manage risk-based Computer System Validation planning and execution, aligned to regulatory guidelines • Establish and enforce QA policies and procedures for PFM systems • Input to the Application Development Lifecycle (ADLC) processes to represent regulated technologies • Serve as the primary liaison with regulatory agencies and third parties for system-related audits and inspections