Prolific logo
Prolific

Building a better world with better data.

Data Quality Engineer, AI Business

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 51-200Since 2014H1B SponsorCompany SiteLinkedIn

Location

Mexico

Posted

66 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Quality Engineer, AI Business

Prolific

Data Quality Engineer, AI Business Team: Client Services Prolific Prolific isn’t just enabling AI innovation – we’re redefining it. While foundational AI technologies are becoming commoditized, Prolific’s human data infrastructure provides the high-quality, diverse data required to train the next generation of AI models. Through our platform, we empower researchers and companies to access a global, ethically curated participant base, ensuring cutting-edge AI research and training grounded in inclusivity and precision. The Role As a Data Quality Engineer within Prolific AI Data Services, you will be the quality guardian for our managed service studies. You will design and operationalise the measurement systems, automation, and launch gates that ensure the data we deliver is trustworthy, authentic, and scalable. This role sits at the intersection of data quality, automation, and integrity. You’ll work closely with Product, Engineering, Operations, and Client teams to embed quality and authenticity into study design and execution—enabling faster launches without compromising trust as task types and volumes evolve. What You’ll Be Doing - Own end-to-end quality design for Prolific managed service studies, including rubrics, acceptance criteria, defect taxonomies, severity models, and clear definitions of done. - Define, implement, and maintain quality measurement systems, including sampling plans, golden sets, calibration protocols, agreement targets, adjudication workflows, and drift detection. - Build and deploy automated quality checks and launch gates using Python and SQL, such as schema and format validation, completeness checks, anomaly detection, consistency testing, and label distribution monitoring. - Design and run launch readiness processes, including pre-launch checks, pilot calibration, ramp criteria, full-launch thresholds, and pause/rollback mechanisms. - Partner with Product and Engineering to embed in-study quality controls and authenticity checks into workflows, tooling, and escalation paths. - Write and continuously improve guidelines and training materials to keep participants, reviewers, and internal teams aligned on evolving quality standards. - Investigate quality and integrity issues end to end, running root-cause analysis across guidelines, UX, screening, training, and operations, and driving corrective and preventive actions (CAPAs). - Build dashboards and operating cadences to track defect rates, rework, throughput versus quality trade-offs, integrity events, and SLA adherence. - Lead calibration sessions and coach QA leads and reviewers to improve decision consistency, rubric application, and overall quality judgement. - Translate one-off quality fixes into repeatable, scalable playbooks across customers, programs, and study types. What You’ll Bring to the Role - 5+ years of experience in quality engineering, data or annotation quality, analytics engineering, trust and integrity, or ML/LLM evaluation operations. - Strong proficiency in Python and SQL, with comfort applying statistical concepts such as sampling strategies, confidence levels, and agreement metrics. - A proven track record of turning ambiguous or messy quality problems into clear metrics, automated checks, and durable process improvements. - Strong quality systems thinking, with the ability to translate complex edge cases into clear rules, tests, rubrics, and governance mechanisms. - Hands-on experience instrumenting workflows and implementing pragmatic automation that catches quality and integrity issues early. - Demonstrated ability to influence cross-functional teams (Product, Engineering, Operations, Client teams) and drive change without direct authority. - Strong customer empathy, with a clear understanding of what “useful, trustworthy data” means for research, AI training, and evaluation use cases. Even Better if you have: - Familiarity with data collection mechanics (screeners, quota/routing constraints, study design patterns). - LLM evals, red teaming, or policy-based annotation experience. - Data/versioning discipline (dataset lineage, change control, reproducibility). - Experience with integrity/fraud detection systems and anti-abuse tooling Why Prolific is a great place to work We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems. We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviors into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation – one that reflects the breath and the best of humanity. Working for us will place you at the forefront of AI innovation, providing access to our unique human data platform and opportunities for groundbreaking research. Join us to enjoy a competitive salary, benefits, and remote working within our impactful, mission-driven culture. At Prolific, our compensation packages for eligible roles include base salary, equity, and benefits. Many roles also include the opportunity to earn a cash variable element, such as a bonus or commission. Each job posting shows a salary range that reflects the minimum and maximum target for new hires, based on the role’s location as well as your skills, experience, and relevant education or training. Your recruiter will also be happy to share the specific salary range for your preferred location during the hiring process. Links to More Information Website Youtube Privacy Statement By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organisation planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal information.

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 51-200Since 2023H1B No Sponsor

• Collaborate with customers and internal teams to assess legacy data environment: structures, sources, volumes, quality, and constraints. • Own migration solutioning: evaluate requirements, design approaches, and propose viable paths when blockers arise. • Independently explore unfamiliar systems to understand source data structure in relation to gaiia’s data model and product. • Collaborate with gaiia’s engineers on data extraction (databases, reports, flat files, APIs, etc.), and transformation approach aligned with business needs. • Take ownership of unblocking challenges by identifying workarounds and translating business and technical issues into actionable steps. • Support user acceptance testing (UAT) and ensure stakeholders see expected data outcomes. • Plan and execute cutover strategy: final "delta" migrations, downtime considerations, and rollback plans. • Monitor post-cutover data, resolve discrepancies, and ensure stability in production. • Produce documentation of the migration: mapping specs, transformation rules, data anomalies, and decision logs. • Manage migration execution progress through project management tools. • Communicate status, risks, and issues to implementation stakeholders and clients.

Canada
Gong logo

GTM Data Architect

Gong

The Revenue Intelligence Platform

Data Engineer66 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io. At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career. Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io. At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career. The GTM Data Architect owns the end-to-end strategy, governance, and execution of how data is orchestrated, enriched, controlled, and activated across the GTM organization. This role ensures that data is not just accurate, but usable, scalable, and embedded directly into workflows that drive adoption and performance. You will serve as the central owner of account and lead data strategy, bridging RevOps, Field Ops, Systems, Sales, Marketing, and AI/Automation teams to create a forward-looking, execution-ready data foundation. RESPONSIBILITIES - Data Orchestration Strategy - Own the holistic strategy for how data flows across systems (SFDC, enrichment tools, AI tools, Gong,etc.). - Define how data is created, updated, validated, enriched, and consumed across GTM workflows. - Ensure consistency, scalability, and clarity in data ownership and data movement. - Enrichment Strategy - Design and own the enrichment framework (firmographics, technographics, intent, personas, buying groups, etc.). - Determine where enrichment happens, what tools are used, and how it is validated. - Balance automation, accuracy, cost efficiency, and business value. - Lead Routing Stakeholder - Be the primary business partner and strategic stakeholder for lead routing logic. - Ensure routing rules align to segmentation, territories, verticals, and coverage models. - Partner closely with Marketing Ops, Field Ops and GTM Systems to ensure speed, accuracy, and transparency. - Account Data Ownership - Serve as the business owner for account-level data integrity and partner with the territories team on account data requirements. - Partner with the territory team and provide data supported recommendations on account definitions, hierarchies, segmentation, industry classification, and account status logic. - Process, Change Management & Communication - Own change management for any data model or process updates. - Create clear communication plans, documentation, and rollout strategies. - Ensure stakeholders understand what is changing, why it matters, and how to use it across the organization including Finance, Data, SysOps, Marketing Operations and the full GTM Operations team. - Forward-Looking Data Strategy - Partner with RevOps and Finance leadership to define where data strategy needs to be in 6–12–24 months. - Anticipate and support analysis on future GTM needs (AI readiness, automation, segmentation evolution, new products, new routes to market). - Ensure data foundations are built with scale and flexibility in mind. - Workflow Integration - Ensure data is embedded directly into seller and manager workflows. - Lead and partner with the entire GTM Ops team to make data actionable, not passive. - Optimize for adoption, clarity, and speed to value. - Data Controls & Governance - Own strong data control processes: - Field-level governance - Validation rules - Exception handling - Auditability - Clear ownership models - Maintain a “single source of truth” mindset across the GTM ecosystem. QUALIFICATIONS - 5+ years in RevOps, GTM Ops, Data Strategy, or Sales Operations roles - Deep understanding of CRM architecture (Salesforce strongly preferred) - Strong experience with: - Proven ability to: - Exceptional communication and change management skills - Comfortable operating between strategy and execution PERKS & BENEFITS - We offer Gongsters a variety of medical, dental, and vision plans, designed to fit you and your family’s needs. - Wellbeing Fund - flexible wellness stipend to support a healthy lifestyle. - Mental Health benefits with covered therapy and coaching. - 401(k) program to help you invest in your future. - Education & learning stipend for personal growth and development. - Flexible vacation time to promote a healthy work-life blend. - Paid parental leave to support you and your family. - Company-wide recharge days each quarter. - Work from home stipend to help you succeed in a remote environment. The annual salary hiring range for this position is $138,000 - $210,000 USD. Compensation is based on factors unique to each candidate, including, but not limited to, job-related skills, qualification, education, experience, and location. At Gong, we have a location-based compensation structure, which means there may be a different range for candidates in other locations. The total compensation package for this position, in addition to base compensation, may include incentive compensation, bonus, equity, and benefits. Some of our sales compensation programs also offer the potential to achieve above targeted earnings for those who exceed their sales targets. We are always looking for outstanding Gongsters! So if this sounds like something that interests you regardless of compensation, please reach out. We may have more roles for you to consider and would love to connect. We have noticed a rise in recruiting impersonations across the industry, where scammers attempt to access candidates' personal and financial information through fake interviews and offers. All Gong recruiting email communications will always come from the @gong.io domain. Any outreach claiming to be from Gong via other sources should be ignored. Gong is an equal-opportunity employer. We believe that diversity is integral to our success, and do not discriminate based on race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, military status, genetic information, or any other basis protected by applicable law. To review Gong's privacy policy, visit https://www.gong.io/gong-io-job-candidates-privacy-notice/ for more details. #LI-EM2

United States
$138K - $210K / year
TLVTech logo

Senior Data Engineer

TLVTech

Your Israeli tech partner

Data Engineer66 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

• Design and maintain scalable data pipelines with Spark Structured Streaming. • Implement Lakehouse architecture with Apache Iceberg. • Develop ETL processes for data transformation. • Ensure data integrity, quality, and governance. • Collaborate with stakeholders and IT teams for seamless solution integration. • Optimize data processing workflows and performance.

Israel
SQLI logo

Data Engineer – Apprentice

SQLI

A European full-service digital company

Data Engineer66 days ago
InternshipRemoteTeam 1,001-5,000Since 1990H1B No Sponsor

• Contribute to implementing data strategies to address our clients' business challenges. • Help implement data pipelines to collect, transform, and process data in collaboration with data scientists. • Prepare presentations, demonstrations, proofs of concept (POCs), or pilot projects to showcase technological recommendations. • Develop data ingestion jobs (preparation, ingestion, processing, and quality checks). • Participate in the technical community (technology watch, knowledge sharing across Business Units, etc.).

France