Job Closed
This listing is no longer active.
Ethos blends industry expertise and technology to provide accessible and affordable life insurance coverage.
AI Engineer
Location
United States
Posted
138 days ago
Salary
$146K - $236K / year
Seniority
Senior
Job Description
AI Engineer
Ethos
• Production RAG: indexing, retrieval, hybrid search, reranking, query rewriting, grounding, citations • Context Graph: entity resolution + linking + provenance; graph + vector retrieval; supports multi-hop context • LLM orchestration: tool/function calling, structured outputs, routing across model tiers, failure modes • GPU/inference cost optimization: batching, caching/KV reuse, quantization, autoscaling; optimize $/session + latency • Safety + compliance: PII/PHI handling, redaction, audit logs, deterministic replay, hallucination mitigation • LLMOps: eval harness (golden sets, regression, adversarial), monitoring for quality/cost/drift • Design/ship the end-to-end pipeline: retrieve → assemble context → generate → cite → log/monitor • Improve quality and trust via evaluation, feedback loops, and clear evidence-backed outputs • Partner with product, security, and domain teams; write crisp design docs; raise engineering bar • Ship RAG v1 with citations + measurable quality metrics • Deliver Context Graph v1 that improves retrieval on real copilot tasks • Reduce cost/latency with a concrete inference optimization plan shipped to prod.
Job Requirements
- 5+ years building production systems; 2+ years hands-on LLMs/RAG
- Proven RAG experience (embeddings, vector DBs, hybrid search, reranking, eval)
- Strong backend/distributed systems + observability
- Track record shipping in high-stakes environments with auditability/correctness
- Knowledge graph / entity resolution / provenance systems
- GPU inference optimization (vLLM/TGI/TensorRT-LLM, quantization AWQ/GPTQ, batching)
- Regulated domain experience (insurance/fintech/healthcare).
Benefits
- You can find further details of our US benefits at https://www.ethoslife.com/careers/
Related Guides
Related Job Pages
More AI Engineer Jobs
• Build and deploy enterprise-ready AI solutions using LLMs, other GenAI approaches, and deep learning capabilities. • Scale out AI solutions: optimize performance of solutions, automate deployment and testing • Rapidly prototype and iterate on AI applications using Azure, AWS, and off-the-shelf tools. • Partner with the AI Solutions Architect to ensure scalable, secure, and compliant system design. • Develop APIs and lightweight UIs (e.g., Dash, Flask and others) to deliver AI tools to end users. • Stay current on emerging AI technologies, including vector databases, RAG pipelines, and productivity AI platforms. • Drive delivery of AI components aligned with product roadmaps and business priorities.
Lead AI Engineer – GCP, GenAI
DKSH Portugal, Unipessoal, Lda.Distributor of Specialty Chemicals and Innovative Ingredients. Market Expansion Services Provider
• Design, build, and operate LLM-powered systems using Gemini and Vertex AI • Implement RAG architectures at scale, including ingestion, retrieval, and generation • Build and orchestrate LLM agents using LangChain or similar frameworks • Integrate AI capabilities via API-driven architectures • Debug and optimize end-to-end LLM pipelines: Chunking strategies, Embeddings, Retrieval logic, LLM response behavior • Deliver production-ready AI services, including: Monitoring and observability, Rate limiting and cost controls, Reliability and fallback strategies • Contribute to solution design and technical decision-making • Continuously evaluate and experiment with new LLM models and platform features • Implement AI safety, security, and compliance controls • Collaborate with cross-functional teams across time zones
Senior AI Engineer
CDWCDW Corporation is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. For more information about CDW, please visit www.CDW.com. Our broad array of products and services range from hardware and software to integrated IT solutions such as security, cloud, hybrid infrastructure and digital experience.
• Agentic Engineering & Orchestration Workflow Design: Architect complex, multi-agent workflows using Microsoft AI tech stack. • Design, Develop and Deploy agents to handle loops, interruptions, and human-in-the-loop interventions. • Tool Use & Function Calling: Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g., Salesforce, Workday, ServiceNow etc.). • State Management: Design persistence layers to manage agent memory, conversational history, and context windows efficiently. • Advanced Data & RAG Strategy Retrieval Pipelines: Build production-grade data retrieval and integration systems. • Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval. • Data Quality: Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption. • LLMOps, Evaluation & Quality Automated Evaluation: Build CI/CD pipelines for AI that include "LLM-as-a-Judge" testing. • Leverage frameworks to score agent outputs for accuracy, hallucination, and safety before deployment. • Observability: Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production. • Cost Optimization: Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs. • Innovation & Collaboration: Prototyping to Production: Rapidly validate new ideas using state-of-the-art models, then refactor successful prototypes into maintainable, tested production code. • Standards Adoption: Stay ahead of the curve by evaluating emerging technologies to standardize agent connectivity.
• Build, iterate, and scale AI-powered features using LLMs and modern AI platforms, with a strong focus on application-level integration • Help define and drive Prokeep’s AI strategy, including where and how AI should be used across the product • Serve as an internal evangelist and subject-matter expert for AI, helping teams understand capabilities, tradeoffs, and best practices • Lead AI evaluation and testing efforts, owning not just the AI engines but also the testing and evaluation frameworks used to measure quality, reliability, and performance • Design and maintain internal tooling to support AI development, experimentation, and evaluation • Partner with Product, Engineering, and Leadership to identify high-impact opportunities where AI can improve customer workflows • Make thoughtful decisions around model selection, orchestration, prompting strategies, and cost/performance tradeoffs • Work closely with our Data Engineer to ensure the right data foundations exist to support AI features • Ensure AI systems are production-ready, observable, and scalable • Improve systems already in flight while contributing to greenfield initiatives—AI is not a silo here




