Job Closed

This listing is no longer active.

Pillar Labs logo
Pillar Labs

Pillar Labs serves as the internal R&D and innovation engine behind some of the most technically advanced human data annotation in the world. We sit at the intersection of human expertise and artificial intelligence, developing cutting-edge systems, methodologies, and tools that push the boundaries of agentic AI training and evaluation data. Our mission is to enable models to think, reason, and act with greater autonomy, accuracy, and depth of understanding.

Project Specialist - Generalist Annotation

Location

United States + 42 moreAll locations: United States | United Kingdom | Germany | France | Estonia | Portugal | Hungary | Poland | Ukraine | Romania | Bulgaria | Czechia | Slovakia | Belarus | Moldova | Sweden | Greece | Belgium | Italy | Ireland | Switzerland | Netherlands | Finland | Malta | Denmark | Lithuania | Croatia | Spain | Austria | Bosnia And Herzegovina | Iceland | Luxembourg | North Macedonia | Montenegro | Norway | Serbia | Slovenia | Albania | Cyprus | Latvia | Monaco | Canada | United Arab Emirates

Posted

96 days ago

Salary

0

Seniority

Mid Level

No structured requirement data.

Job Description

Project Specialist - Generalist Annotation

Pillar Labs

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description We’re looking for a Project Specialist — project expert + reviewer of reviewers — to help uphold and continuously improve the quality of our annotation projects. In this role, you’ll act as a subject matter expert across multiple initiatives, balancing hands-on quality review with process optimization and annotator support. You’ll collaborate closely with Project Managers and the core team to refine standards, review reviewer performance, and ensure our annotation work consistently meets the highest bar for clarity, consistency, and precision. You’ll play a key role in maintaining a healthy and well-supported annotator community by triaging issues, answering questions, and enforcing communication and conduct guidelines across our internal platforms. Primary Responsibilities - Project Expertise & Quality Management (75–80%) - Serve as a subject matter expert for assigned projects, maintaining deep familiarity with annotation guidelines, tools, and workflows. - Collaborate with the core team to refine and clarify annotation standards and processes. - Review annotations and evaluate reviewer performance, providing structured, actionable feedback. - Identify common errors, inconsistencies, or points of confusion — and recommend or implement process improvements. - Support updates to annotation instructions, training materials, and onboarding guides to reflect evolving project needs and lessons learned. - Monitor project metrics and contribute to internal quality discussions or calibration sessions. - Annotator-Facing Issue Management, Community Support & Moderation (20–25%) - Triage and respond to questions, reports, and discussions in internal forums or communication channels. - Escalate complex or high-impact issues to the appropriate project or operations leads. - Enforce community and communication guidelines, including moderating discussions and addressing conduct violations when necessary. - Collect and synthesize annotator feedback to identify recurring themes, improvement opportunities, or emerging risks. - Collaborate with Project Managers to ensure feedback loops are closed and community needs are addressed promptly and transparently. Qualifications - Have 2+ years of experience in annotation, review, copy editing, or content moderation. - Have 1+ years working in a senior annotator or reviewer role, or have 1+ years of experience operationally supporting projects. - Have an overlap with UK/European business hours and can work an alternate schedule with 1 weekend day. - Can consistently catch 90%+ of common errors and inconsistencies in annotated data. - Thrive on process improvement, spotting patterns, and suggesting changes that save time or reduce errors. - Are comfortable working in fast-changing project environments with multiple stakeholders. Previous start-up experience preferred. - Have excellent written communication skills; able to provide clear, respectful, and actionable feedback. - Are an empathetic communicator who values community, well-being, and fairness. Company Description Pillar Labs serves as the internal R&D and innovation engine behind some of the most technically advanced human data annotation in the world. We sit at the intersection of human expertise and artificial intelligence, developing cutting-edge systems, methodologies, and tools that push the boundaries of agentic AI training and evaluation data. Our mission is to enable models to think, reason, and act with greater autonomy, accuracy, and depth of understanding.

Job Requirements

  • Have 2+ years of experience in annotation, review, copy editing, or content moderation.
  • Have 1+ years working in a senior annotator or reviewer role, or have 1+ years of experience operationally supporting projects.
  • Have an overlap with UK/European business hours and can work an alternate schedule with 1 weekend day.
  • Can consistently catch 90%+ of common errors and inconsistencies in annotated data.
  • Thrive on process improvement, spotting patterns, and suggesting changes that save time or reduce errors.
  • Are comfortable working in fast-changing project environments with multiple stakeholders. Previous start-up experience preferred.
  • Have excellent written communication skills; able to provide clear, respectful, and actionable feedback.
  • Are an empathetic communicator who values community, well-being, and fairness.

Related Categories

Related Job Pages

More QA Engineer Jobs

Headlands Research logo

Director, Clinical Quality Assurance

Headlands Research

Headlands Research is improving patients’ lives by advancing innovative medical therapies.

QA Engineer96 days ago
OtherRemoteTeam 201-500Since 2018H1B No Sponsor

• Oversee and direct the Quality Department, ensuring its alignment with the broader business strategy and adherence to industry standards, while establishing clear goals and promoting a culture of quality, compliance, and ongoing improvement. • Communicate, train, and author (when applicable) Standard Operating Procedures (SOPs) including periodic review/revisions of procedures and policies to ensure compliance with regulations and guidelines in both the US and Canada. • Develop and maintain key performance indicators (KPIs) to evaluate the effectiveness of quality assurance activities and initiatives. • Conduct and/or oversee annual and monthly quality reviews. • Support the corporate development team through quality review of potential acquisition candidates.

Florida
Job Closed
Plug and Play Tech Center logo

QA Engineer

Plug and Play Tech Center

Driving the future forward with corporations, governments, startups, investors, and universities.

QA Engineer96 days ago
Full TimeRemoteTeam 501-1,000Since 2006H1B No Sponsor

• Perform manual testing of features and mobile/desktop applications • Execute test cases across all functional and UI areas of our Live Casino products • Create detailed and well-structured test setups, test plans and test cases • Analyze requirements and specifications • Report bugs in Jira and follow up with development teams

Qatar
Job Closed
Full TimeRemoteTeam 1,001-5,000Since 1998H1B No Sponsor

• Review and analyze system specifications • Mentor and collaborate with QA Engineers to develop effective strategies, frameworks and test plans • Write test cases based on user stories • Write automated test cases and contribute to common C# automation framework • Create logs to document testing phases and defects • Report bugs and errors to development teams • Help troubleshoot issues • Conduct post-release/ post-implementation testing • Work with cross-functional teams to ensure quality throughout the software development lifecycle

Qatar
PLN120 - PLN150 / hour
Job Closed
IME RESOURCES LLC logo

Clinical Quality Assurance Coordinator (31677)

IME RESOURCES LLC

ExamWorks is a leading provider of innovative healthcare services including independent medical examinations, peer reviews, bill reviews, Medicare compliance, case management, record retrieval, document management, and related services. Clients include property and casualty insurance carriers, law firms, third-party claim administrators, and government agencies. Services confirm the veracity of claims by sick or injured individuals under automotive, disability, liability, and workers' compensation insurance coverages.

QA Engineer96 days ago
OtherRemoteTeam 2-10

Job DetailsJob Location: Norwood, MA 02062Position Type: Full TimeSalary Range: $27.00 - $31.25 HourlyTravel Percentage: NoneReady for Your Next Big Career Move? Use Your Clinical Expertise - All Without Leaving Home! Are you a Registered Nurse (RN) looking for a role that challenges you, supports your growth, and offers true work‑life balance? MES has an incredible opportunity that lets you make an impact from the comfort of your couch. We’re seeking a Clinical Quality Assurance Coordinator to join our team! In this role, you’ll ensure our Peer Review case reports consistently meet the highest standards of quality, accuracy, and compliance with client requirements, regulatory guidelines, and federal/state mandates. 100% Remote – Work where you’re most comfortable and productive. Meaningful Impact – Your expertise directly supports the integrity of our clinical review process. Flexible Schedule - Monday through Friday with rotating (approximately every 4 weeks) weekends. Three days of 8:00am-4:30pm EST and two days of 12:00pm-8:30pm EST (One of which is Friday) Responsibilities include: Perform quality assurance review of peer review reports, correspondences, addendums or supplemental reviews. Ensure clear, concise, evidence-based rationales have been provided in support of all recommendations and/or determinations. Ensure that all client instructions and specifications have been followed and that all questions have been addressed. Ensure each review is supported by clinical citations and references when applicable and verifies that all references cited are current and obtained from reputable medical journals and/or publications. Ensure the content, format, and professional appearance of the reports are of the highest quality and in compliance with company standards. Ensure the appropriate board specialty has reviewed the case in compliance with client specifications or state mandates and is documented accurately on the case report. Verify that the peer reviewer has attested to only the facts and that no evidence of reviewer conflict of interest exists. Ensure the provider credentials and signature are adhered to the final report. Identify any inconsistencies within the report and contacts the Peer Reviewer to obtain clarification, modification or correction as needed. Assist in resolution of client complaints and quality assurance issues as needed. Ensure all federal ERISA and state mandates are adhered to at all times. Provide insight and direction to management on consultant quality, availability and compliance with all company policies and procedures and client specifications. Promote effective and efficient utilization of company resources. Participate in various educational and or training activities as required. Perform other duties as assigned. QualificationsHigh school diploma or equivalent required. A minimum of two years clinical or related field experience; or equivalent combination of education and experience. Knowledge of the insurance industry preferably claims management relative to one or more of the following categories: workers' compensation, no-fault, liability, and/or disability. Must have strong knowledge of medical terminology, anatomy and physiology, medications and laboratory values. Must be able to add, subtract, multiply, and divide in all units of measure, using whole numbers and decimals; Ability to compute rates and percentages. Must be a qualified typist with a minimum of 40 W.P.M Must be able to operate a general computer, fax, copier, scanner, and telephone. Must be knowledgeable of multiple software programs, including but not limited to Microsoft Word, Outlook, Excel, and the Internet. Must possess excellent skills in English usage, grammar, punctuation and style. Ability to follow instructions and respond to upper managements’ directions accurately. Demonstrates accuracy and thoroughness. Looks for ways to improve and promote quality and monitors own work to ensure quality is met. Must demonstrate exceptional communication skills by conveying necessary information accurately, listening effectively and asking questions where clarification is needed. Must be able to work independently, prioritize work activities and use time efficiently. Must be able to maintain confidentiality. MES Solutions is a premier provider of independent medical examination and peer review services to the insurance, corporate, legal, and government sectors. Members of our credentialed medical panel conduct physical examinations or medical record reviews, delivering reports that assist clients in the resolution of automotive, disability, liability, and workers' compensation claims. MES has been providing services nationally since 1978 in accordance with the industry's highest standards of operating excellence and regulatory compliance. MES offers a fast-paced team atmosphere with competitive benefits (medical, vision, dental), paid time off, and 401k. Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.

United States
$27 - $31 / hour