Role Description Multimodal Analysis Framework (MAF) is an end‑to‑end platform designed to process diverse content sources—including video, images, audio, and documents—to generate rich, structured metadata. The platform unifies multiple ML/AI models to extract curated insights at scale, tailored to specific business needs. MAF supports both on‑demand workloads (batch uploads, ad‑hoc analysis) and real‑time streaming workflows, enabling continuous metadata generation for live content streams. Customers can define their metadata requirements—such as entity extraction, scene segmentation, object detection, transcription, summarization, or multimodal correlation—and the framework orchestrates the appropriate models and toolchains to deliver high‑quality outputs. Through flexible APIs and UI‑based workflows, customers and internal teams can visualize metadata, trigger enrichment, monitor processing, and integrate results into downstream applications. The platform emphasizes modularity, scalability, and extensibility to support new ML models, LLM‑based agents, and cross‑modal inference as use cases evolve. We are looking for a mid-level Backend Engineer to join our Machine Learning Platform team. This role focuses on building scalable backend systems that power ML workloads, including video, image, and document processing, and enable LLM-driven applications through agents and MCP servers. You will work primarily in Golang, deploy and operate services on Kubernetes, manage infrastructure with Terraform, and build on AWS. A core part of the role is designing platform capabilities that allow LLMs to safely and reliably interact with tools, data, and services via agent frameworks and MCP servers. Qualifications - 3–6 years of professional software engineering experience. - Strong backend engineering experience with Golang. - Experience building and operating APIs (REST and/or gRPC) in production. - Hands-on experience with Kubernetes in production environments. - Experience using Terraform for infrastructure provisioning and deployment. - Solid working knowledge of AWS cloud services and core architectural concepts. - Experience building or supporting ML processing pipelines (video, image, or document). - Practical experience using LLMs in production systems. - Experience developing agents and/or MCP servers, or equivalent tool-integration platforms. Requirements - Design, build, and maintain high-performance backend services in Golang for ML and AI platform use cases. - Develop REST and gRPC APIs for inference, processing pipelines, orchestration, and platform services. - Implement asynchronous and distributed processing patterns (workers, queues, event-driven systems). - Ensure backend services meet production standards for scalability, reliability, and security. - Build and operate backend systems supporting video processing (frame extraction, metadata generation, embeddings, indexing). - Build and operate backend systems supporting image processing (OCR, classification, detection, embedding generation). - Build and operate backend systems supporting document processing (parsing, layout analysis, chunking, OCR, retrieval pipelines). - Integrate ML inference services into backend workflows with attention to latency, throughput, and cost. - Work closely with ML engineers and data scientists to productionize models and pipelines. - Build LLM-enabled backend services using structured prompting, tool/function calling, and retrieval-augmented generation (RAG). - Design and implement agentic workflows (multi-step reasoning, tool orchestration, retries, guardrails). - Develop and operate MCP servers that expose internal platform capabilities (search, retrieval, processing, data access) to LLM-based applications. - Enforce security, access control, and observability for agent and MCP interactions. - Design and maintain vector-based retrieval systems using Milvus. - Implement embedding ingestion, indexing, and query pipelines at scale. - Optimize retrieval quality, latency, and relevance for downstream LLM applications. - Deploy and operate backend and ML services on Kubernetes (scaling, rollouts, resource management). - Use Terraform for infrastructure provisioning and continuous delivery of cloud resources. - Build and operate primarily on AWS, leveraging services such as compute, networking, and IAM; object storage; managed Kubernetes; logging and monitoring services. - Implement observability using logs, metrics, and traces; define SLOs and alerts. - Write automated tests (unit, integration) and contribute to CI/CD pipelines. - Participate in on-call rotations and incident response; drive post-incident improvements. Benefits - Base pay range: $142,651.46 - $213,977.19, dependent on job-related, non-discriminatory factors such as experience. - Most sales positions are eligible for a Commission under the terms of an applicable plan. - Most non-sales positions are eligible for a Bonus. - Best-in-class benefits to eligible employees, personalized to meet the needs of employees.