• Operational implementation of AI agents • Development of new AI agents based on clearly defined requirements • Ensuring the stability and practical effectiveness of AI agents • Configuring, maintaining, and optimizing existing GenAI applications • Testing prompts, logic, and workflows • Monitoring new AI tools and technical developments • Evaluating and practically testing new approaches

Role Description As a Senior AI Engineer focused on Agentic Evaluation and Verification and Validation (V&V), you will join the AI and Data Science team within Slingshot’s Research and Development organization. You will contribute to advancing how intelligent systems are evaluated and validated for mission-critical space operations. - Extend and maintain Slingshot’s V&V SDK and evaluation framework for simulation-backed validation of agentic AI systems - Design and implement agent-level and end-to-end evaluations, including benchmark scenarios, scoring logic, and experiment harnesses - Build benchmark scenarios and tooling that measure planning, reasoning, and operational performance for autonomous mission planning systems - Translate astrodynamics and mission-domain concepts into executable evaluation scenarios and simulation configurations - Develop reusable SDK interfaces, adapters, and evaluation utilities that connect V&V systems, TALOS benchmarks, and agent workflows - Define and apply metrics for capability evaluation, failure analysis, regression detection, and comparative benchmarking - Partner with cross-functional teams to identify evaluation needs and contribute to improving coverage of critical capabilities - Contribute to best practices for evaluating complex, autonomous AI systems - Uphold strong engineering standards through testing, documentation, reproducibility, and maintainable system design Qualifications - 6+ years of experience in software engineering, machine learning engineering, applied AI, or equivalent experience - Strong Python engineering skills with experience building SDKs, libraries, or evaluation tooling - Experience designing evaluation frameworks, benchmarks, metrics, or test harnesses for AI/ML systems - Ability to analyze system behavior, identify failure modes, and evaluate performance in complex autonomous or semi-autonomous systems - Familiarity with modern agent frameworks, orchestration patterns, or protocol-based integrations - Experience working in cross-functional, multidisciplinary teams - Strong written and verbal communication skills - Bachelor’s degree in a relevant science or engineering field, or equivalent experience - Must be a U.S. citizen and eligible to obtain and maintain a government security clearance Requirements - Experience in autonomous systems such as self-driving or ADAS, including perception, planning, simulation, or safety validation - Experience developing or evaluating agentic AI systems, including multi-step, tool-using, or autonomous workflows (e.g., LLM-based agents, planning agents, or reinforcement learning approaches) - Experience with reinforcement learning systems and simulation-based evaluation - Familiarity with benchmark design, experiment tracking, and trace-based evaluation workflows - Experience with orchestration frameworks such as LangGraph or similar tools - Knowledge of astrodynamics, orbital mechanics, or spacecraft mission planning - Experience translating mission or operational concepts into measurable evaluation scenarios - Familiarity with physics-based simulation, trajectory analysis, or space-domain modeling - Experience with observability and experiment tooling such as MLflow, Opik, or similar platforms - Experience transitioning advanced research systems into production environments Benefits - Remote work opportunity - Salary range: $150,000-$250,000 - Full-time exempt classification (learned professional exemption)

Role Description Ayrin Digital is looking for a Full Stack Software Engineer who operates like a product builder—not just a feature implementer. This role is ideal for someone who is comfortable working across frontend, backend, infrastructure, and collaborating on product development, with a strong focus on building AI-powered systems. You will be expected to bring a strong product mindset and take ideas from concept to production-ready solutions. This is a high-ownership role where engineering, product thinking, and AI expertise come together. - End-to-End Development: - Build scalable, production-ready features across the stack - Own delivery from UI → backend → deployment - Product Collaboration: - Work closely with Product Owners and SMEs - Contribute to improving usability, performance, and business outcomes - Full Stack Development: - Frontend: React, Next.js - Backend: Node.js, NestJS - Database: PostgreSQL - Cloud: AWS - AI-Powered Systems: - Build AI-driven features that deliver real value - Design AI workflows using LLMs and automation tools - AI Development & Optimization: - Implement AI skills and workflows - Work with tools like Claude, OpenRouter, LangChain, n8n - Optimize latency, cost, and performance - Integrate multiple AI models where needed - AI-Enabled Engineering: - Use AI tools to accelerate development - Define best practices for AI-assisted coding - Scalable Architecture: - Design flexible, scalable systems - Balance speed with long-term maintainability Qualifications - Core Engineering: - Strong experience with React, Next.js - Node.js, NestJS - PostgreSQL - Experience with APIs, microservices, distributed systems - Strong understanding of AWS or cloud infrastructure - AI / ML Expertise: - Hands-on experience with LLMs - Experience with prompt engineering - Model selection & evaluation - Performance & cost optimization - Familiarity with Claude, OpenRouter, LangChain - Multi-model orchestration - Experience building AI systems in production - Product Mindset: - Strong focus on usability and product quality - Ability to convert ideas into working solutions - Experience collaborating with product teams - AI-Enabled Development: - Experience using AI tools in development workflows - Understanding of where AI adds value Requirements - Nice to Have: - Experience with CrewAI or similar frameworks - Exposure to Hugging Face / open-source LLMs - Experience with RAG pipelines and vector databases - Background in data engineering - CI/CD, DevOps, observability - Startup / 0→1 product experience - Polyglot experience (Python, Java, .NET) Benefits - Why Join Us: - This role is at the intersection of engineering and product innovation. - You’ll work on building real-world AI-powered products and have a direct impact on business outcomes.

Role Description Develop and ship production AI agents, including orchestration frameworks and eval harnesses. - Design and implement tool-use runtimes and multi-step workflows for agent systems. - Evaluate and improve retrieval systems that agents utilize for enhanced performance. - Collaborate on both frontier-lab and applied-product projects to innovate AI solutions. - Work independently and asynchronously to meet project goals with flexible hours. Qualifications - Experience in building in-house agent frameworks or cloud-agents runtime. - Expertise in eval infrastructure for agents, including offline and online systems. - Proficiency with tool-use, MCP, or orchestration layers. - Knowledge of memory, retrieval, or state-passing primitives for agents. Requirements - 20 mins async AI screen covering agent architectures and eval practices. - Live follow-up for top signals. Benefits - Compensation: $500/hour - Location: Remote Application Process - Upload resume - AI interview based on your resume - Submit form Resources & Support - For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome - For any help or support, reach out to: support@mercor.com - Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.