IT's that simple.
AI Platform Engineer
Location
United States
Posted
1 day ago
Salary
0
Seniority
Senior
Job Description
AI Platform Engineer
DATAGROUP
• Du entwickelst und betreibst unsere souveräne LLM-Plattform inklusive OpenAI-kompatiblem Gateway, Modell-Serving und GPU-Infrastruktur • Du implementierst kundenspezifische Wissensanbindungen (RAG) mit Vector-Datenbanken, Embeddings und Reranking • Du stellst Kostenkontrolle, Mandantentrennung, Datenschutz und Guardrails sicher • Du etablierst Monitoring und Observability für Performance, Qualität und Nutzung der KI-Dienste • Du betreibst und entwickelst unsere containerbasierte Plattform auf Basis von Docker, Coolify und Kubernetes weiter • Du automatisierst Deployments und verantwortest CI/CD-Prozesse für unsere Eigenentwicklungen • Du betreust unsere Linux-, Cloud- und Datenbank-Infrastruktur und sorgst für Stabilität, Sicherheit und Verfügbarkeit • Du baust Monitoring-, Logging- und Alerting-Lösungen auf und entwickelst diese weiter • Du gestaltest die Architektur unserer Plattform- und KI-Services aktiv mit • Du etablierst Infrastructure as Code und standardisierte Deployment-Prozesse • Du sorgst für datenschutzkonforme und mandantensichere Betriebsmodelle • Du dokumentierst Lösungen, teilst Wissen im Team und evaluierst neue Technologien im Bereich Platform Engineering und KI
Job Requirements
- Abgeschlossenes Studium der (Wirtschafts-) Informatik oder eine vergleichbare Qualifikation
- Mehrjährige Erfahrung im DevOps-, Plattform-Engineering- oder Cloud-/Infrastruktur-Umfeld
- Fundierte Praxiserfahrung im Betrieb containerbasierter Anwendungen und moderner Plattformen
- Erfahrung im Aufbau und produktiven Betrieb von LLM- und KI-Diensten, idealerweise in selbst gehosteten Umgebungen
- Sehr gute Kenntnisse in Kubernetes, Docker und Linux
- Erfahrung mit CI/CD-Pipelines, Cloud-Plattformen (insbesondere Azure) sowie PostgreSQL
- Praktische Erfahrung mit LLM-Gateways, RAG-Architekturen, Vector-Datenbanken und Modell-Serving-Lösungen
- Solide Python-Kenntnisse für Automatisierung und Integrationen
- Eigenständige und strukturierte Arbeitsweise mit hoher Eigenverantwortung sowie Sicherheits- und Datenschutzbewusstsein
- Ausgeprägtes Architektur- und Platformverständnis
Benefits
- Offene und kooperative Unternehmenskultur
- Vertrauensvolle Arbeitsatmosphäre
- Umfassende Einarbeitung mit Unterstützung des gesamten AIS Teams
- Flache Hierarchien und kurze Entscheidungswege
- Strategische Gestaltungsrolle mit großem Einfluss auf die zukünftige Plattformlandschaft
- Mitarbeit an einem der spannendsten Technologiefelder der IT: souveränes LLM-Hosting und KI-Infrastrukturen
- Moderne Infrastruktur mit Kubernetes, Docker, CI/CD und Cloud-Technologien
- Möglichkeit, Standards, Prozesse und Architekturentscheidungen aktiv mitzugestalten
- Individuelles Weiterbildungsbudget für Konferenzen, Zertifizierungen und Fachtrainings
- Klare Karriere- und Entwicklungspfade
- Möglichkeit zur Spezialisierung als AI Platform Engineer bzw. LLMOps-Experte
- Kleines, fokussiertes und agiles Team mit kurzen Entscheidungswegen
- Offene Feedback-Kultur mit regelmäßigen 1:1-Gesprächen und Retrospektiven
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
Staff Platform Engineer
Defense UnicornsWe help mission-focused heroes solve the world’s biggest software challenges.
• Architect and maintain scalable runtime production environments across cloud-native and containerized systems, including transforming applications into Kubernetes-friendly formats for bare-metal deployment • Own the technical roadmap for the platform vertical, identifying gaps, planning initiatives, and aligning engineering effort to mission objectives • Provide mentorship to engineers across the team, fostering professional development and raising the technical bar • Identify technical overlap across projects and guide teams on leveraging each other for efficient delivery • Work closely with Mission Managers, providing insights on engineering competency, capacity, velocity, and alignment with mission objectives • Collaborate with product teams, providing feedback on product fit and contributing to product direction based on production usage • Work with customers to define technical roadmaps that align to mission objectives • Advocate for and enforce DevSecOps practices across the platform layer, including security automation, container security, and compliance • Evaluate and select optimal methods for solving complex business problems, assessing new products and their potential impact on mission objectives • Drive continuous improvement in CI/CD pipelines, deployment patterns, and operational tooling
• Design, build, test, and operate distributed backend services and APIs that support high-volume customer interactions. • Take end-to-end ownership of platform work, from framing ambiguous problems and shaping technical plans through implementation, rollout, and production support. • Improve reliability, scalability, latency, and cost across shared platform systems that serve teams across the business. • Partner closely with Product, SRE, and peer engineering teams to deliver platform improvements without destabilizing live traffic. • Participate in on-call, incident response, troubleshooting, and continuous improvement of alerting, runbooks, deployment quality, and capacity planning. • Raise engineering standards through code reviews, design reviews, pairing, documentation, and mentorship for other engineers on the team.
Staff Software Engineer, Subscription and Membership Platform
hims & hershims & hers offers a modern approach to health and wellness.
• Lead the design and architecture of scalable full-stack solutions aligned with product requirements • Own the architecture of core subscription and membership systems, including billing correctness, lifecycle state management, plan changes, cancellations, and workflow orchestration across commerce, pharmacy, and fulfillment • Partner closely with engineering teams across commerce, clinical care, pharmacy, and fulfillment to drive cross-functional technical initiatives and ensure platform decisions scale across the organization • Provide mentorship on best practices, design patterns, and coding standards • Advocate for team technical needs within the broader engineering organization • Participate in product discovery and validation through prototypes and experiments • Partner with product and design to ensure platform capabilities support an intuitive end-to-end customer experience • Drive strategic technical decisions to improve security, scalability, and performance • Break down complex projects into actionable tasks • Establish and enforce consistent coding and testing standards • Initiate efforts to reduce technical debt and enhance workflow efficiency • Implement tools and processes for monitoring, incident response, and performance optimization • Implement analytics and monitoring to demonstrate how engineering solutions directly impact key customer activation and reactivation KPIs • Analyze metrics and user feedback to continuously improve the platform • Maintain thorough technical documentation • Conduct code reviews and facilitate knowledge-sharing initiatives
Senior Data Platform Engineer
CRAFTSMAN+Create, automate, innovate, and turn your creative needs into successful marketing.
• Build and optimize data pipelines (batch and streaming). • Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data. • Design software that is easily testable and maintainable. • Support in setting data strategies and our vision. • Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft. • Work on extendable data processing systems that allows to add and scale pipelines. • Apply machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets. • Leverage AI-powered development tools (e.g. Cursor) to accelerate development, refactoring, and code generation.




