Job Closed
This listing is no longer active.
Cincinnatus is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for full-time and long-term contingent roles. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve full-time or fixed-term commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus. Equal Employment Opportunity Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.
AI Red-Teamer — Adversarial AI Testing
Location
United States + 2 moreAll locations: United States | United Kingdom | Canada
Posted
108 days ago
Salary
0
Seniority
Mid Level
No structured requirement data.
Job Description
AI Red-Teamer — Adversarial AI Testing
Mercor
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description At Mercor, we believe the safest AI is the one that’s already been attacked — by us. That’s why we’re building a pod of AI Red-Teamers: human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red-team data that makes AI safer for our customers. This role may include reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text-based, and participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources. What You’ll Do - Red-team AI models and agents: jailbreaks, prompt injections, misuse cases, exploits - Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks - Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent - Document reproducibly: produce reports, datasets, and attack cases customers can act on - Flex across projects: support different customers, from LLM jailbreaks to socio-technical abuse testing Qualifications - You bring prior red-teaming experience (AI adversarial work, cybersecurity, socio-technical probing) - You’re curious and adversarial: you instinctively push systems to breaking points - You’re structured: you use frameworks or benchmarks, not just random hacks - You’re communicative: you explain risks clearly to technical and non-technical stakeholders - You’re adaptable: thrive on moving across projects and customers Requirements - Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction - Cybersecurity: penetration testing, exploit development, reverse engineering - Socio-technical risk: harassment/disinfo probing, abuse analysis - Creative probing: psychology, acting, writing for unconventional adversarial thinking Benefits - Build experience in human data-driven AI red-teaming at the frontier of safety - Play a direct role in making AI systems more robust, safe, and trustworthy - The pay rate for this role may vary by project, customer, and content category. Compensation will be aligned with the level of expertise required, the sensitivity of the material, and the scope of work for each engagement.
Job Requirements
- You bring prior red-teaming experience (AI adversarial work, cybersecurity, socio-technical probing)
- You’re curious and adversarial: you instinctively push systems to breaking points
- You’re structured: you use frameworks or benchmarks, not just random hacks
- You’re communicative: you explain risks clearly to technical and non-technical stakeholders
- You’re adaptable: thrive on moving across projects and customers
- Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction
- Cybersecurity: penetration testing, exploit development, reverse engineering
- Socio-technical risk: harassment/disinfo probing, abuse analysis
- Creative probing: psychology, acting, writing for unconventional adversarial thinking
Benefits
- Build experience in human data-driven AI red-teaming at the frontier of safety
- Play a direct role in making AI systems more robust, safe, and trustworthy
- The pay rate for this role may vary by project, customer, and content category. Compensation will be aligned with the level of expertise required, the sensitivity of the material, and the scope of work for each engagement.
Related Guides
Related Job Pages
More AI Engineer Jobs
• Implement DLP, MIP, retention, Sensitivity Labels, and secure configuration. • Administer and operationalize enterprise LLM platforms (Copilot, Gemini, ChatGPT Enterprise, Claude). • Develop connectors, automations, and reusable patterns for AI and M365 workloads. • Troubleshoot permission issues, data routing, and cross workspace access. • Provide hands on engineering for data governance enforcement.
Senior AI Engineer
CRODUCRODU is a full-stack JavaScript software house. We deliver fresh, creative, and results-driven solutions to our clients
• Współtworzenie frameworków ewaluacyjnych, rozwiązań w obszarze proctoringu oraz krytycznych mechanizmów bezpieczeństwa. • Ocena i wdrażanie najnowocześniejszych (state-of-the-art) technik AI/ML. • Implementacja systemów automatycznego generowania treści oraz integracja rozwiązań AI (LLM, OCR) z workflowami i narzędziami automatyzacji. • Tworzenie eksperymentów mających na celu walidację wydajności modeli oraz ich realnego wpływu na biznes oraz optymalizacji kosztów i opóźnień (latency). • Projektowanie, budowanie i wdrażanie skalowalnych usług oraz pipelines AI. • Udział w regularnych konsultacjach technicznych oraz ścisła współpraca z CTO. • Rozwijanie nowoczesnego środowiska programistycznego wspieranego przez AI, aktywne eksperymentowanie i śledzenie najnowszych technologii (LLM, agenci).... • Współpraca z działami Produktu i Designu w celu definiowania funkcji napędzanych przez AI. • Produkcyjne wdrażanie modeli z wykorzystaniem nowoczesnych praktyk MLOps oraz LLMOps oraz budowa systemów monitoringu i zabezpieczeń (guardrails).
AI Engineer
Eureka LabsExcelling Product Factory Partner for fast-growing marketplaces & SaaS companies. #ThinkBuildEnjoy #ChallengeYourself
• Build and maintain AI-powered data pipelines and extraction processes (batch and streaming) from internal relational data sources and unstructured documents (PDF, Word, PowerPoint) into structured datasets within Databricks. • Design and manage text embeddings and vector stores within Databricks for use with vector indexing and retrieval solutions. • Design, develop, and maintain custom tools implemented as MCP servers and Databricks applications to extend agent and model capabilities. • Design, develop and implement AI Agents using frameworks like LangChain and LangGraph. • Implement LLM scorers to validate and monitor agents, applications and models. • Prevent issues like hallucinations or unnecessary actions through structured testing and guardrails. • Drive continuous improvement through prompt engineering, pipeline optimization, vector store tuning, and scorer refinement to ensure high-quality LLM responses. • Collaborate on production deployments, monitoring, and scalability of ML and LLM-based services.
The Artificial Intelligence (AI) Solutions Architect (Contractor) will work with our existing internal AI product management team, Vendor Teams and existing development staff to develop, enhance and streamline our AI systems. Lead the design and implementation of secure, scalable AI and Agentic AI solutions aligned with DES mission, policies, and public-sector standards. Define end-to-end AI architectures including data ingestion, RAG pipelines, LLM orchestration, and human-in-the-loop workflows. Provide technical leadership, relevant architectural documentation for approvals, and guidance to internal teams and system integrators. Ensure compliance with State of Arizona security, privacy, accessibility, and data-governance requirements (PII, HIPAA, CJIS where applicable). Establish reference architectures and best practices for responsible, ethical, and compliant AI use across DES. Evaluate and integrate AI platforms, cloud services, and vendor solutions in coordination with procurement and legal teams. Design architectures that support explainability, auditability, bias mitigation, and transparency in decision-support systems. Collaborate with DevOps (cloud ops), cybersecurity, and data teams to operationalize AI solutions from proof of concept to production systems. Support AI strategy, roadmap development, and executive briefings to scale AI capabilities across DES programs.
