Instacart invites the world to share love through food. This is how homemade is made.
Senior Software Engineer II, ML/AI Platform
Location
California + 18 moreAll locations: California | Colorado | Connecticut | District Of Columbia | Hawaii | Illinois | Maine | New Hampshire | New Jersey | New York | Oregon | Maryland | Massachusetts | Pennsylvania | Rhode Island | Texas | Vermont | Virginia | Washington
Posted
40 days ago
Salary
$192K - $242K / year
Seniority
Senior
Job Description
Senior Software Engineer II, ML/AI Platform
Instacart
• Play a key role in building the internal platform which supports training and deploying AI models across the entire organization. • Take ownership of defining the platform to enable AI model fine-tuning and batch inference by building the SDKs and supporting the infra. • Manage cross-cutting stakeholder relationships, prioritizing customer needs first. • Navigate ambiguous, hairy, and technical problem spaces. • Jump into domains, languages, and problem areas that might be new and unfamiliar.
Job Requirements
- Bachelor’s degree in Computer Science, a related field, or equivalent practical experience
- 3 years of experience with software development in one or more programming languages
- 2 years of experience in designing, analyzing, and troubleshooting large-scale distributed systems, and 1 years of experience leading projects and providing technical leadership
- Strong proficiency in maintaining high standards for production services
- Rapid coding skills and management of production services
- Experience with high scale throughput and distributed systems problems.
Benefits
- Instacart provides highly market-competitive compensation and benefits
- Offers may vary based on many factors, such as candidate experience and skills required for the role.
- Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants.
Related Guides
Related Job Pages
More AI Engineer Jobs
AI-Driven SAP Developer AI-Driven SAP Developer
Körber GroupKörber is shaping the future of end-to-end supply chain automation across Europe, North America, and Asia with our cutting-edge material handling solutions and system integration expertise. Set new industry standards and champion customer-centric services and solutions with our dynamic Automation team based in Sandy Springs, Georgia, USA. This full-time, exempt role offers a remote work setting.
We are seeking a forward-thinking Full-Stack Developer to bridge the gap between robust SAP S/4HANA stability and the next generation of AI-driven enterprise applications. You will be responsible for building high-performance, Clean Core compliant extensions using SAP Business Technology Platform (BTP) and crafting intuitive front-end experiences with UI5, Angular. In this role, you won't just write code; you will actively integrate SAP AI Core and generative AI tools to accelerate delivery, automate complex business processes, and bring intelligent insights to the heart of the enterprise. What You’ll Do - Develop scalable, AI-driven applications on SAP BTP, leveraging SAP AI Core and AI Foundation services. You won't just build apps; you’ll architect systems that integrate Generative AI into core business processes (like Lead-to-Cash or Source-to-Pay). - Maximize productivity by using AI coding assistants (GitHub Copilot, Cursor) and SAP-specific LLMs to write, refactor, and document CAP (Cloud Application Programming Model) or RAP code. You are expected to stay at the forefront of prompt engineering for automated code generation. - Design and manage data pipelines that bridge the gap between structured SAP data and unstructured insights. This includes integrating RESTful APIs and managing high-performance databases, specifically utilizing SAP HANA Cloud’s vector engine for RAG (Retrieval-Augmented Generation) architectures. - Maintain a rigorous Git workflow to ensure stability in complex SAP landscapes. You will follow Gitflow strategies to manage clean commits and painless merges, ensuring that AI model configurations and application logic are versioned with enterprise-level precision. - Develop modular, reusable components in Angular (or SAP UI5) that integrate seamlessly with AI features. Your goal is to create "Agentic" user interfaces—UIs that don't just display data but provide AI-powered recommendations and natural language interactions. - Use Docker to containerize AI models and microservices, ensuring consistent execution environments. You will deploy and manage these workloads via SAP AI Core, ensuring your models are production-ready, resource-efficient, and compliant with SAP’s "Clean Core" strategy - Collaborate: Participate in code reviews (giving and receiving) and agile ceremonies. - Continuous Learning: Stay ahead of the curve by testing and adopting new AI dev-tools that improve the team’s workflow. What You Bring to the Table The Core Stack: - CAP (Cloud Application Programming Model): Strong foundation in Node.js or Java. Experience with the CAP framework is a must for building enterprise-grade services that integrate seamlessly with SAP HANA. - SAPUI5 / Fiori: Proficiency in JavaScript/TypeScript and modern SAPUI5. You understand the Fiori Design Guidelines and can build responsive, enterprise-ready frontends that users actually enjoy. - Git & CI/CD: You know the difference between a rebase and a merge, and you’re comfortable managing code versioning within SAP Continuous Integration and Delivery or Azure DevOps. - BTP & Containers: You can navigate the SAP BTP Cockpit, deploy MTAs (Multi-Target Applications), and understand why "Cloud Foundry" and "Kyma" (Kubernetes) are the backbone of modern SAP extensibility. The AI & Tooling Edge: - AI Orchestration: Experience using AI tools for boilerplate generation, unit test creation, and complex debugging. - Prompt Engineering: The ability to craft precise instructions for LLMs to get high-quality, secure code outputs. - Critical Evaluation: You don't just "Copy-Paste" AI suggestions; you have the technical depth to audit AI code for security vulnerabilities and performance bottlenecks. HITL (Human in the Loop) The "Nice-to-Haves": - Experience integrating OpenAI/Anthropic/Gemini APIs into web applications. - Familiarity with vector databases (like pgvector or Pinecone) or LangChain. - Familiarity with Cloud platforms (AWS, Azure, or GCP). - A "testing" mindset—experience with JUnit, or Jasmine/Karma or equivalent Who You Are - Pragmatic: You know when to write code from scratch and when to let an AI assistant do the heavy lifting. - Curious: You don't wait for a training manual; you're already experimenting with the latest LLM models and plugins. Quality-Focused: You understand that as AI generates more code, the human's role as a "Code Reviewer" becomes even more vital. What we offer - Flexible working hours and remote work - Innovative, interdisciplinary team environment - Employee benefits such as bonuses, cafeteria, Körber sports club, health fund, pension fund We are Körber – an international technology group with about 12,000 employees, more than 100 locations worldwide and a common goal: We turn entrepreneurial thinking into customer success and shape the technological change. In the Business Areas Digital, Pharma, Supply Chain and Technologies, we offer products, solutions and services that inspire. We act fast to customer needs, we execute ideas seamlessly, and with our innovations we create added value for our customers. In doing so, we are increasingly building on ecosystems that solve the challenges of today and tomorrow. Körber AG is the holding company of the Körber Group.
Senior AI Developer
3Core Systems, IncDelivering end-to-end SAP System Integration and IT Professional Services for Emerging Technologies
• Supporting an AI development team in SecTechOps • Building and testing agents • Developing use cases for further investment and adoption
• Advanced Prompt Engineering: Designing complex, dynamic prompt templates with conditional logic and efficiently reusing information and context within prompts to maximize generation quality and reasoning. • Structured Outputs & Schemas: Implementing various response schemes (JSON mode, function calling, Zod/JSON schemas) to ensure AI outputs are predictable and ready for seamless integration into application logic. • Prompt Engineering & Evaluations: Building robust evaluation pipelines and using Langfuse to collect feedback and score the quality of responses in real time. • Tracing & Debugging: Performing deep debugging of complex LLM chains using Langfuse traces to identify bottlenecks and optimize for cost, latency, and context window usage. • AI A/B Testing: Running systematic experiments across different models via OpenRouter (e.g., comparing Claude 3.5 Sonnet vs. GPT-4o) and analyzing results based on quantitative metrics. • Data-Driven Decisions: Making deployment decisions for new prompts or models strictly based on quantitative benchmarks and trace data, rather than intuition. • Output Scoring & Analysis: Developing scoring systems to analyze the “Problem → Solution” chain and identify root causes of hallucinations or logic errors using Langfuse analytics. • Model Performance & Fine-Tuning: Regularly re-evaluating model performance as new architectures emerge and performing fine-tuning when necessary to meet specific domain requirements.
• Model Development – Design, train, fine-tune, and evaluate models spanning classical ML, deep learning (CNNs, transformers), and generative AI (LLMs, diffusion). • Data Exploration & Analytics – Conduct exploratory data analysis, statistical testing, and time-series / forecasting to inform features, prompts, and business KPIs. • End-to-End Pipelines – Build reproducible workflows for data ingestion, feature engineering / prompt stores, training, CI/CD, and automated monitoring. • LLM & Agentic AI Engineering – Craft prompts, retrieval-augmented generation (RAG) pipelines, and autonomous/assistive agents; fine-tune LLMs on domain-specific datasets to boost accuracy and align outputs with product requirements. • AI Automation & Integration – Expose AI components as micro-services and event-driven workflows; integrate with orchestration tools (Airflow, Prefect) and business APIs to automate decision pipelines. • Continuous Learning – Track advances in LLMs, vision, and analytics; share insights and best practices with the wider engineering team. • Mentor junior engineers and contribute to technical direction and engineering best practices.



