AI insights + over 600 years of NFL expertise.
LLMOps Platform Engineer
Location
United States
Posted
101 days ago
Salary
0
Seniority
Senior
Job Description
LLMOps Platform Engineer
SumerSports
• Build and operate the LLM Platform: Develop model routing, prompt registry, and orchestration services for multi-model workflows. • Integrate external LLM APIs (OpenAI, Anthropic, Mistral) and internal finetuned models. • Enable fast, safe experimentation: Implement automated evaluation pipelines (offline + online) with golden sets, rubrics, and regression detection. • Support CI/CD for prompt and model changes, with rollback and approval gates. • Collaborate cross-functionally: Partner with product pods to instrument RAG pipelines and prompt versioning. • Work with deep learning and data teams to integrate structured and unstructured retrieval into LLM workflows. • Optimize performance and cost: Profile latency, token usage, and caching strategies. • Build observability and monitoring for LLM calls, embeddings, and agent behaviors. • Ensure reliability and safety: Implement guardrails (toxicity, PII filters, jailbreak detection). Maintain policy enforcement and audit logging for AI usage.
Job Requirements
- 5+ years of experience in applied ML, NLP, or ML infrastructure engineering
- Strong coding skills in Python and experience with frameworks like LangChain, LlamaIndex, or Haystack
- Solid understanding of retrieval-augmented generation (RAG), embeddings, vector databases, and evaluation methodologies
- Experience deploying models or AI systems in production environments (AWS, GCP, or Azure)
- Familiarity with prompt management, LLM observability, and CI/CD automation for AI workflows
Benefits
- Competitive Salary and Bonus Plan
- Comprehensive health insurance plan
- Retirement savings plan (401k) with company match
- Remote working environment
- A flexible, unlimited time off policy
- Generous paid holiday schedule - 13 in total including Monday after the Super Bowl
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
• Own multi‑cloud provisioning, upgrading, and reliability of the core platform • Automate everything via infrastructure as code and GitOps • Ship fully automated deployments across regions • Standardize developer experience across areas such as tooling and CI/CD • Optimize our stack’s scalability and maintain cost‑awareness for AI workloads
MS Power Platform Engineer
Globaldev GroupBuilding remote teams and providing software development solutions for tech businesses 🇺🇸🇮🇱🇩🇪🇺🇦🇵🇹🇵🇱
• Develop and maintain business applications using Power Apps (Canvas and/or Model-Driven Apps) • Design and implement workflows and business process automation using Power Automate • Work with Dataverse: Data modeling and relationships, Business rules and logic, Security roles and access management • Integrate external systems using REST APIs (HTTP / JSON) • Troubleshoot, debug, and optimize existing solutions • Collaborate with stakeholders to gather requirements and translate them into technical solutions • Ensure best practices in performance, scalability, and security
Platform Engineer
happyhotelThe revenue management software for the hotel industry. Generate more revenue with dynamic price management.
• Du entwickelst unsere Cloud-Foundation weiter und etablierst eine skalierbare, wartbare Cloud-Architektur nach Best Practices (AWS Well-Architected) • Du baust Standards, reduzierst Infrastruktur-Workload für die Produktteams • Du sorgst dafür, dass Infrastrukturänderungen zuverlässig, reproduzierbar und sicher ablaufen • Du überimmst das Steuer für unsere Cloud-Foundation und baust sie nach AWS Well-Architected Best Practices massiv aus • Du machst Terraform bei uns zum Gesetz und etablierst IaC als Standard • Du baust die Security-Baseline, die uns ruhig schlafen lässt • Du standardisierst Patterns, baust modulare Templates und sorgst für eine Doku, die man wirklich gerne liest • Du unterstützt die Devs durch Enablement und Reviews
Senior Platform Engineering Architect
Komatsu Poland Sp. z o.o.Maszyny budowlane - sprzedaż, wynajem, serwis. Jesteśmy wyłącznym dystrybutorem maszyn Komatsu w Polsce.
• Zdefiniowaniu docelowej architektury platformy (API-first, contract-based design) • Projektowaniu i wdrożeniu modelu zarządzania lifecycle infrastruktury • Ustanowieniu standardów integracyjnych pomiędzy usługami (compute, storage, bazy danych, eventing) • Zaprojektowaniu podejścia do Infrastructure as Code i automatyzacji na poziomie enterprise • Wbudowaniu observability i telemetry jako obowiązkowego elementu kontraktu platformowego • Zaprojektowaniu mechanizmów inventory oraz reconciliation (Discovery/Inventory/Telemetry) • Zapewnieniu spójności architektonicznej w złożonym środowisku technologicznym • Pełnieniu roli technicznego autorytetu w rozmowach z architektami, zespołami domenowymi i operacyjnymi
