CDW Corporation is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. For more information about CDW, please visit www.CDW.com. Our broad array of products and services range from hardware and software to integrated IT solutions such as security, cloud, hybrid infrastructure and digital experience.
Senior AI Engineer
Location
Illinois
Posted
136 days ago
Salary
$124K - $174.6K / year
Seniority
Senior
Job Description
Senior AI Engineer
CDW
• Agentic Engineering & Orchestration Workflow Design: Architect complex, multi-agent workflows using Microsoft AI tech stack. • Design, Develop and Deploy agents to handle loops, interruptions, and human-in-the-loop interventions. • Tool Use & Function Calling: Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g., Salesforce, Workday, ServiceNow etc.). • State Management: Design persistence layers to manage agent memory, conversational history, and context windows efficiently. • Advanced Data & RAG Strategy Retrieval Pipelines: Build production-grade data retrieval and integration systems. • Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval. • Data Quality: Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption. • LLMOps, Evaluation & Quality Automated Evaluation: Build CI/CD pipelines for AI that include "LLM-as-a-Judge" testing. • Leverage frameworks to score agent outputs for accuracy, hallucination, and safety before deployment. • Observability: Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production. • Cost Optimization: Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs. • Innovation & Collaboration: Prototyping to Production: Rapidly validate new ideas using state-of-the-art models, then refactor successful prototypes into maintainable, tested production code. • Standards Adoption: Stay ahead of the curve by evaluating emerging technologies to standardize agent connectivity.
Job Requirements
- Core Engineering: Bachelor’s degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications.
- AI Specialization: 2+ years specifically building with LLMs, with deep familiarity in: Orchestration: LangChain, LangGraph, or similar state-based frameworks.
- Vector DBs: Pinecone, Weaviate, or pgvector.
- Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot).
- Production Mindset: Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors.
- Soft Skills: Ability to explain "probabilistic software" to non-technical stakeholders—managing expectations that agents are never 100% accurate, but can be 100% useful.
- Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer.
Benefits
- Opportunity to design and build the next generation of enterprise AI agents.
- A collaborative environment where experimentation and innovation are encouraged.
Related Guides
Related Job Pages
More AI Engineer Jobs
• Build, iterate, and scale AI-powered features using LLMs and modern AI platforms, with a strong focus on application-level integration • Help define and drive Prokeep’s AI strategy, including where and how AI should be used across the product • Serve as an internal evangelist and subject-matter expert for AI, helping teams understand capabilities, tradeoffs, and best practices • Lead AI evaluation and testing efforts, owning not just the AI engines but also the testing and evaluation frameworks used to measure quality, reliability, and performance • Design and maintain internal tooling to support AI development, experimentation, and evaluation • Partner with Product, Engineering, and Leadership to identify high-impact opportunities where AI can improve customer workflows • Make thoughtful decisions around model selection, orchestration, prompting strategies, and cost/performance tradeoffs • Work closely with our Data Engineer to ensure the right data foundations exist to support AI features • Ensure AI systems are production-ready, observable, and scalable • Improve systems already in flight while contributing to greenfield initiatives—AI is not a silo here
Senior/Staff AI Engineer
HomeboundHomebound is the first tech-powered homebuilding company of its kind—now building in CA, TX, CO and FL.
• Shape the vision for how AI/ML, particularly LLMs, integrate into Homebound’s products and operations. Define technical standards for experimentation, deployment, and evaluation. • Design and build scalable AI systems that can handle real-world production workloads and evolve with the business. • Deliver high-quality, production-grade code daily while ensuring observability, maintainability, and reliability. • Raise the bar across engineering by teaching AI best practices, reviewing designs, and guiding engineers through complex technical challenges. • Stay abreast of the rapidly evolving AI landscape, bringing forward cutting-edge ideas while focusing investment where it creates clear business impact.
Machine Learning Engineer – AI Platform Lead
Artera.netArtera is a Swiss ISP that produces premium hosting and cloud services.
• Develop the long term vision and roadmap for Artera’s AI platform that will allow the company to continue to scale in terms of both increased inference volume and development workloads. • Accountable for Artera’s ML compute infrastructure including scaling up Artera’s Foundation Model development by developing distributed training infrastructure and developer libraries. • Build and evolve the core libraries used by AI scientists to develop, launch, and monitor AI products. • Work with model developers to optimize GPU and CPU efficiency and data throughput of large-scale foundation models and downstream model training runs. • Optimize Artera’s ability to store and serve terabytes of digital pathology data efficiently for the use in serving large-scale training regimes. • Ensure that Artera’s observability infrastructure provides a clear picture of how to continue to optimize performance across our model landscape.
• AI Orchestration: Design and deploy autonomous agents to automate dev processes (e.g., automated PR summaries, synthetic test data generation, and self-healing test suites). • Workflow Automation: Build and maintain complex product workflows leveraging LLMs and RAG (Retrieval-Augmented Generation) to enhance user experiences. • Infrastructure as Code (IaC): Own the cloud architecture using Terraform or Pulumi to ensure GCP resources (Vertex AI, Cloud Run, Cloud SQL) are version-controlled and reproducible. • Full-Stack Development: Maintain and evolve our dual-portal ecosystem: Backend: Node.js, Express, and TypeORM (PostgreSQL). Frontend: React (v17 & v18) using modern state management and routing (Zustand, TanStack). • DevOps Mastery: Implement robust CI/CD pipelines (GitHub Actions/Google Cloud Build) that handle both application code and AI model versioning.




