Pareto.AI

• Partnering directly with labs to understand their challenges and develop targeted solutions • Configure and present tailored product demonstrations to highlight platform features for potential clients • Advise customers on LLM evaluation best practices and provide strategic AI guidance • Write code, construct specialized evaluation datasets, build custom web applications, and produce technical documentation to train customers on platform usage • Author technical blog content and promote the product and organization through social platforms and industry gatherings • Partner with interdisciplinary teams across delivery, product, engineering, and ML to influence product roadmap and achieve important business objectives

About us At Pareto.AI, we’re on a mission to enable top talent around the world to participate in the development of cutting-edge AI models. In coming years, AI models will transform how we work and create thousands of new AI training jobs for skilled talent around the world. We’ve joined forces with top AI and crowd researchers at Anthropic, Character.AI, Imbue, Stanford, and University of Pennsylvania to build a fair and ethical platform for AI developers to collaborate with domain experts to train bespoke AI models. About This Role The Trust & Safety Manager owns Pareto's expert integrity function end-to-end. You'll be responsible for defining the standards, building the systems, and leading the team that ensures our expert platform remains fair, safe, and trustworthy—for experts, for customers, and for Pareto. This is not a reactive moderation role. You're building a proactive integrity engine: designing risk frameworks, embedding Trust & Safety into the expert lifecycle, and partnering with Product and AI to turn complex judgment into scalable systems. You'll operate as a cross-functional leader who sits at the intersection of policy, operations, and technology. The best person in this role thinks rigorously about risk, designs processes with the precision of an engineer, and leads their team with the judgment and fairness of a good judge. Qualifications Required - 6+ years in Trust & Safety, integrity, risk, fraud, or investigations—ideally at a marketplace, platform, or data company - Demonstrated experience owning or leading an integrity/T&S function, not just contributing to one - Track record of designing structured, auditable enforcement systems: intake workflows, escalation logic, severity frameworks, sanctions ladders - Strong SQL skills: able to independently query data, build dashboards, and investigate anomalies without waiting on a data team - Strong analytical mindset: comfortable defining metrics, tracking case trends, and using data to improve policy and process - Experience partnering with Product and Engineering to translate judgment-based work into scalable tooling or automation - Ability to write clear, defensible decision rationale—and to coach others to do the same - Calm, precise operator in high-stakes, ambiguous situations with competing pressures - Demonstrated ability to lead small teams with high standards for quality and consistency Nice to Have - Experience at a two-sided marketplace or gig economy platform (Uber, Upwork, Fiverr, Scale AI, etc.) - Exposure to Know Your Customer (KYC), identity verification, fraud tooling, or compliance frameworks - Experience building AI-assisted moderation, risk scoring, or case triage workflows - Background in audit, compliance, legal operations, or quality assurance - Familiarity with distributed workforce or expert marketplace dynamics - Comfortable using AI tools (e.g. Claude, Cursor, ChatGPT) to independently prototype dashboards, scripts, or workflow automations—without needing an engineer to do it for you Key Responsibilities 1. Own the T&S Charter and Enforcement Framework - Define and maintain Pareto's expert Code of Conduct, T&S policies, risk severity tiers, sanctions ladder, and appeals process - Ensure enforcement is consistent, auditable, and aligned with Pareto's expert lifecycle and quality bar - Evolve the charter as Pareto's platform, customer commitments, and risk profile change 2. Build and Run the Investigations Engine - Design and own structured workflows for risk screening (pre-activation) and post-activation investigations - Set evidence standards, documentation requirements, SLAs, and escalation paths - Maintain decision logs and precedent tracking to prevent inconsistent enforcement - Review and approve high-severity or precedent-setting cases 3. Lead and Develop the T&S Team - Manage a team of Risk Screening Specialists and Investigation Specialists - Set clear performance expectations and coach on judgment, rigor, and fairness - Build a team culture that balances firm enforcement with genuine due process 4. Embed T&S into the Expert Lifecycle - Work with Expert Growth to define T&S gates at onboarding, activation, and the Golden Pool - Partner with Data Delivery and Quality Ops to identify gaming, abuse, or performance anomalies that warrant T&S review - Ensure T&S decisions cleanly update expert lifecycle states: active, suspended, reactivation-eligible, offboarded - Collaborate with Community to turn recurring T&S issues into guidelines, training, and preventive education 5. Lead T&S's Relationship with Product and Engineering - Act as the domain owner for all T&S-related product, ML, and engineering decisions - Proactively identify workflows that are high-volume, repetitive, or judgment-heavy—and translate them into clear product or ML problem statements - Define requirements, risk thresholds, guardrails, and escalation logic for automated tools - Provide labeled examples, edge cases, and evaluation frameworks to support model development - Pilot, validate, and monitor automations (risk scoring, document checks, anomaly detection, case triage) - Ensure all T&S tooling supports human judgment, preserves due process, and minimizes expert harm Why This Role Matters Pareto's value to customers and experts depends on the integrity of our platform. Customers trust us to deliver work from vetted, high-quality experts. Experts trust us to treat them fairly. When either side of that trust breaks down, the business suffers. Trust & Safety is how we protect both. Done well, it's a competitive advantage: a platform experts want to stay on, and one customers trust to police itself. Done poorly, it creates inconsistency, expert resentment, and customer churn. As Head of Trust & Safety, you're building the integrity infrastructure that enables Pareto to scale without sacrificing fairness or quality. This requires someone who can design systems with precision, lead a team with high standards, and influence a broader organisation that needs T&S embedded into its daily operations—not bolted on after the fact. What We Value We hire people who take pride in their work, can take something and run with it end-to-end, ask good questions proactively, and have a good attitude. We're building a team of A-players, not protecting mediocre performers. We establish clear standards and hold everyone accountable to them.

• Collaborate with prospective and existing customers to understand their business requirements and challenges. • Develop and prototype tailored solutions using the company's products or services to address customer needs. • Conduct product demonstrations and presentations to showcase the capabilities and benefits of the proposed solutions. • Take ownership of projects, managing them from initiation to successful delivery, ensuring alignment with customer expectations and project timelines. • Work closely with cross-functional teams, including sales, operations, customer success, and engineering, to ensure a cohesive approach to customer solutions. • Maintain a deep understanding of the company's products, technologies, and industry trends, serving as a subject matter expert for both internal teams and external customers. • Establish a feedback loop with customers to gather insights, understand evolving needs, and contribute to product enhancements.

• Own and lead the most complex system design discussions. Be the person the team comes to for architectural decisions. Negotiate, push back, and shape what gets built and what doesn't. • Rapidly assess technical feasibility of AI product ideas before development begins. Produce one-page technical scoping documents that prevent scope creep and surface hidden risks upfront. • Define technology stacks, build reusable frameworks, and establish engineering guidelines that let the team move fast while maintaining quality standards. • Build prototypes with stakeholder alignment, get early signal on whether something will work, and kill or accelerate accordingly. • Partner closely with research, operations, and data teams to understand evolving needs and iterate quickly. Juggle multiple workstreams and make smart tradeoff decisions as priorities shift. • Build systems that raise our execution muscle. Lead evaluation practices that measure AI application effectiveness.

• Lead the renewal assessment for Slack, including reviewing current usage, auditing connected tools and workflows, and making recommendations on contract renewal, optimization, and cost effectiveness • Audit and help clean up Google Workspace and Slack accounts, including user access, permissions, inactive accounts, group structure, and general admin hygiene • Improve company security posture, including implementing or strengthening single sign-on (SSO), identity and access management, device controls, and account provisioning/deprovisioning processes • Create practical documentation, workflows, and standards that improve long-term maintainability and operational readiness • Partner with internal stakeholders across operations, finance, people, and leadership to prioritize projects and deliver improvements with minimal disruption

• Collaborate with prospective and existing customers to understand their business requirements and challenges. • Develop and prototype tailored solutions using the company's products or services to address customer needs. • Conduct product demonstrations and presentations to showcase the capabilities and benefits of the proposed solutions. • Take ownership of projects, managing them from initiation to successful delivery, ensuring alignment with customer expectations and project timelines. • Work closely with cross-functional teams, including sales, operations, customer success, and engineering, to ensure a cohesive approach to customer solutions. • Maintain a deep understanding of the company's products, technologies, and industry trends, serving as a subject matter expert for both internal teams and external customers. • Establish a feedback loop with customers to gather insights, understand evolving needs, and contribute to product enhancements.

• Design end-to-end data collection and evaluation pipelines for RLVR, RLHF, SFT, red-teaming, and model evaluation workflows. • Build, test, and iterate on AI agents that automate pipeline tasks — quality gate review, expert matching, output flagging, throughput anomaly detection. • Define data quality standards across annotation, evaluation, and expert output review. • Engage directly with AI researchers, TPMs, and PMs at client organizations. • Stay current with developments in LLM post-training, evaluation methodology, and data tooling.

• Own the T&S Charter and Enforcement Framework • Build and Run the Investigations Engine • Lead and Develop the T&S Team • Embed T&S into the Expert Lifecycle • Lead T&S's Relationship with Product and Engineering