Job Closed
This listing is no longer active.
Docker helps developers bring their ideas to life by conquering the complexity of app development.
Software Engineer II, AI Developer Tools
Location
United States
Posted
179 days ago
Salary
$132K - $181.5K / year
Seniority
Mid Level
Job Description
Software Engineer II, AI Developer Tools
Docker, Inc
• Build AI Developer Tool Features: Implement features for AI-powered developer tools such as code review assistants, test generators, deployment diagnostics, and on-call assistance tools • Implement LLM Integrations: Build integrations with LLM APIs (OpenAI, Anthropic, etc.) such as prompt engineering, response handling, error management, and performance optimization • Contribute to Platform Infrastructure: Help build self-service platform capabilities such as deployment pipelines, observability integration, security controls, and operational tooling that enable teams to rapidly deploy AI developer tools • Support AI-Native Development Adoption: Contribute to tools and programs that help teams adopt AI developer tools such as Claude Code, Cursor, and Warp across Docker's engineering organization • Write Quality Code: Develop well-tested code with unit and integration tests; follow team coding standards and participate actively in code reviews to learn best practices • Maintain Production Systems: Assist with monitoring, alerting, and troubleshooting production AI systems; participate in incident response and learn operational best practices • Collaborate and Learn: Work closely with Senior Engineers and Principal Engineer on technical designs; ask questions, seek feedback, and continuously improve your skills in AI/LLM technologies and platform engineering • Document Your Work: Create clear technical documentation for features you build; contribute to team knowledge base and help future team members understand systems • Participate in Team Activities: Engage in design discussions, sprint planning, retrospectives, and team activities; contribute ideas for improving developer tools and team processes • Grow Your Expertise: Continuously learn about AI/ML technologies, developer tooling best practices, and platform engineering patterns through hands-on work and mentorship from experienced engineers
Job Requirements
- 2+ years building backend systems, APIs, or developer-facing tools with strong software engineering fundamentals
- Proficiency in Go (preferred), Rust, Java, or Python with understanding of data structures, algorithms, and design patterns
- Basic understanding of AI/ML concepts with eagerness to learn about LLM APIs, prompt engineering, and AI agent development through hands-on work
- Experience with cloud platforms (AWS, GCP, or Azure) and understanding of distributed systems or microservices
- Familiarity with CI/CD pipelines, automated testing, version control (Git), and modern development workflows
- Strong problem-solving skills with ability to work through technical challenges with guidance from senior engineers
- Good communication skills in remote, asynchronous environments with ability to document technical decisions
- Collaborative mindset with eagerness to learn from code reviews and feedback
- Self-motivated with ability to work autonomously while knowing when to ask for help
- Passion for developer tools and user experience
Benefits
- Freedom & flexibility; fit your work around your life
- Designated quarterly Whaleness Days plus end of year Whaleness break
- Home office setup; we want you comfortable while you work
- 16 weeks of paid Parental leave
- Technology stipend equivalent to $100 net/month
- PTO plan that encourages you to take time to do the things you enjoy
- Training stipend for conferences, courses and classes
- Equity; we are a growing start-up and want all employees to have a share in the success of the company
- Docker Swag
- Medical benefits, retirement and holidays vary by country
Related Guides
Related Job Pages
More AI Engineer Jobs
Senior Manager, Engineering – AI Developer Tools
Docker, IncDocker helps developers bring their ideas to life by conquering the complexity of app development.
• Build and Scale the AI Developer Tools Team: Hire, onboard, and develop a high-performing engineering team from the ground up with expertise in AI/LLM integration, platform engineering, and developer experience; establish team culture, technical standards, and operating norms • Ship AI-Powered Developer Tools: Deliver production-ready AI agents for developer productivity (automated PR reviews, code generation, documentation), observability insights (anomaly detection, root cause analysis), and operational automation (deployment pre-reviews and failure investigations, incident response assistance) • Build Self-Service AI Developer Tools Platform: Create and operate the foundational infrastructure that enables teams across Docker to build, deploy, host, and scale their own AI developer tools including deployment frameworks (ArgoCD/GitOps), observability integration (Grafana), security controls, cost management, and operational tooling • Drive Platform Adoption and Developer Experience: Establish the AI Developer Tools platform as the default path for teams building AI-powered tooling; deliver self-service capabilities, comprehensive documentation, templates, and best practices that reduce time-to-production from weeks to days • Partner on AI Strategy and Technology: Work closely with engineering leadership and Agent Dev technical leadership to align on AI technology choices, architectural patterns, and integration strategies; stay current on LLM advancements and developer tooling trends • Explore Productization Opportunities: As internal AI developer tools demonstrate value, partner with product management and go-to-market teams to evaluate commercial viability; prototype, validate, and transition successful internal tools into customer-facing product offerings • Deliver Measurable Impact: Define and track success metrics for both AI developer tools (adoption rates, productivity gains, time saved) and platform capabilities (time-to-deploy new tools, number of teams using platform, operational efficiency) • Cross-Functional Collaboration: Partner with product engineering teams (Hub, Registry, Cloud/AI, Scout, Accounts & Billing), platform teams (Infrastructure, Security, Data), and product leadership to understand requirements, gather feedback, and align on priorities • Operational Excellence: Ensure reliability, security, and performance of AI developer tools and the hosting platform; establish SLOs, monitoring, and incident response for production AI systems serving internal developers • Team Development and Culture: Mentor and grow engineers on your team; foster a culture of experimentation, rapid prototyping, and learning; attract diverse talent excited about AI and developer experience
Senior Associate, ML/AI Engineer – Graph, Vector & Data Platform
EYBuilding a #BetterWorkingWorld by providing trust through assurance and helping organizations grow, transform & operate.
• Design and implement graph data models and entity networks using Neo4j. • Develop and optimize Cypher queries for relationship and network analysis. • Build and maintain vector databases using Postgres (pgvector), Milvus, or Weaviate. • Implement embedding ingestion pipelines for similarity and semantic search use cases. • Design and manage data repositories / lakehouse layers using Apache Iceberg. • Develop data ingestion and transformation pipelines from multiple source system. • Deploy and operate databases and data platforms on Nutanix infrastructure. • Ensure performance tuning, scalability, availability, and fault tolerance. • Implement data quality checks, monitoring, and error handling. • Collaborate with AI/ML, analytics, and application teams. • Document data models, architectures, and operational procedures.
• Design and deliver production-grade agentic AI systems on Azure AI Foundry, ensuring solutions go well beyond PoC and into scalable, enterprise-ready platforms. • Architect end-to-end pipelines leveraging Azure OpenAI, vector search, tool-calling patterns, and LangChain / Semantic Kernel for orchestration. • Define and enforce REST API design standards, JSON schema definitions, and event/message-based integration patterns across AI workloads. • Lead the evolution of solutions from MVP to productized platforms, including refactoring, hardening, and meeting non-functional requirements around performance, reliability, observability, and security. • Deploy and oversee scalable Azure infrastructure (AKS, App Service, Functions, or equivalent), collaborating with DevOps/SRE teams to define runbooks, SLIs/SLOs, and monitoring frameworks. • Evaluate and integrate emerging agent frameworks and patterns (MCP, A2A) to continuously modernize platform capabilities. • Use LangSmith or equivalent tooling to implement tracing, evaluation, and quality assurance across agentic pipelines. • Document architectures, sequence diagrams, and interaction flows using Visio, Figma, or similar tools; facilitate collaborative design sessions using Mural/Miro with distributed teams. • Partner with cross-functional and multi-program teams to ensure platform components are reused and versioned effectively across products. • Support incident management and post-mortems, contributing to a culture of continuous improvement in live production contexts.
Senior AI Engineer
Companion GroupThe most ambitious game studios in the world choose Companion as their companion
• Architect, implement, and refine cutting-edge multiplayer-ready gameplay systems in and outside of the Unreal Engine • Produce elegant, efficient, and maintainable C++ code • Leverage expert-level understanding of data structures and algorithms to solve interesting challenges • Collaborate with cross-functional teams to deliver innovative gameplay experiences • Contribute to the development of scalable and robust networking solutions • Tackle and resolve intricate technical hurdles in complex multiplayer games



