Job Closed
This listing is no longer active.
The cloud ☁️ of choice for developers, startups, and growing digital businesses around the world.
Senior Engineer, Inference Data Plane
Location
Massachusetts
Posted
89 days ago
Salary
$139.2K - $174K / year
Seniority
Senior
Job Description
Senior Engineer, Inference Data Plane
DigitalOcean
• Drive the design and development of distributed services within our AI Infrastructure ecosystem. • Create, refine, and assess system design proposals for our high-scale, multi-tenant inference cloud ecosystem. • Lead the operational strategy for critical services, defining SLOs and leveraging advanced observability. • Partner deeply with Product Management, TPMs, and Engineering Management peers to align technical roadmaps with business priorities. • Work on new architecture initiatives that enable fleet optimization and help evolve DigitalOcean into a market leader.
Job Requirements
- Deep experience with distributed and cloud services, including messaging systems, databases, and infrastructure as code, observability, and security.
- Advanced knowledge of cloud networking (VPCs, Load Balancers), containerization (Kubernetes), and cloud storage (block, object, NFS).
- Proven experience building AI/ML products, specifically focusing on Gen AI platforms, LLM hosting, and inference workflows.
- Significant experience running customer-facing, high-availability services across multiple regions.
- Experience integrating and building with open-source software and a bias for technical ownership.
- Expert proficiency in GoLang or Python and familiarity with gRPC for service-to-service communication.
Benefits
- We provide employees with reimbursement for relevant conferences, training, and education.
- All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.
- We will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few.
- You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance.
- We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Fullstack Developer (Java WebFlux + Angular)
KeppriEspecialistas en el end to end de activos digitales, staffing y Servicios Tecnológicos. Hazlo fácil con KEPPRI !!!
Role Description ¡Únete a nuestro equipo como Fullstack Senior y construye soluciones robustas y escalables! Buscamos un perfil con experiencia sólida en backend Java moderno (Spring Boot + WebFlux) y participación activa en frontend con Angular, para desarrollar productos digitales con altos estándares de calidad, rendimiento y mantenibilidad, en un entorno cloud sobre AWS. Tus responsabilidades serán: - Diseñar, desarrollar y mantener microservicios y componentes backend con Java + Spring Boot + WebFlux. - Construir e integrar APIs REST seguras, eficientes y bien documentadas. - Desarrollar funcionalidades en Angular, asegurando buenas prácticas, modularidad y una experiencia de usuario consistente. - Asegurar calidad con pruebas unitarias, revisiones de código y mejora continua. - Participar en equipos ágiles (planning, refinamiento, sprints, retrospectivas). - Apoyar despliegues y operación en ambientes cloud (principalmente AWS) junto con el equipo de plataforma/DevOps. Qualifications - Experiencia sólida con Java 21+. - Dominio de Spring Boot y programación reactiva con Spring WebFlux. - Construcción de APIs REST y arquitectura de microservicios. - Conocimiento aplicado de Clean Architecture (estructura mantenible). - Persistencia con Hibernate y experiencia con bases de datos relacionales (PostgreSQL o MySQL). - Pruebas unitarias con JUnit + Mockito. - Manejo de dependencias y build con Gradle 8.x. - Consumo de servicios usando WebClient (WebFlux) (u otros clientes equivalentes). - Experiencia desarrollando aplicaciones web con Angular (ideal versión LTS reciente). - Buen manejo de componentización, consumo de APIs, y buenas prácticas de desarrollo frontend. - Uso de SASS/SCSS y trabajo alineado a un sistema de diseño (design system corporativo). - Experiencia trabajando con servicios de AWS (deseable EKS y RDS/Aurora). - Contenerización con Docker y despliegues en entornos orquestados (Kubernetes/EKS). Requirements - NoSQL: DynamoDB o DocumentDB. - Cache: Redis o Memcached (ElastiCache). - Manejo de secretos con AWS Secrets Manager. - Conocimiento de performance testing (ej. JMeter). - Certificaciones AWS (plus). Benefits - Salario competitivo acorde a tu experiencia. - Trabajo remoto. - Oportunidades de crecimiento profesional. - Cultura enfocada en buenas prácticas de ingeniería. - Proyectos con retos técnicos reales.
• Ramp: In the onboarding stage, senior members of the OR/AI team will get you up to speed on our technologies and help you develop your skill set to the point where you can contribute to the development of cutting-edge optimization and AI tools for the logistics industry • Execute: Engage heavily in the SDLC (research, design, experimentation, development, deployment, monitoring, and maintenance) to ensure stability and quality of the codebase • Research and Implement: best practices to enhance our existing machine learning infrastructure in production environments • Ideate: You will have the freedom to ideate and apply novel methodologies and techniques • Grow: You will have the ability to learn directly from leaders in the AI and optimization fields
• Own core pieces of our data lake and analytics stack (e.g., Iceberg, Spark) • Design and evolve data systems that balance cost, latency, data freshness, and reliability • Partner closely with PM, product analytics, and GTM leaders to shape commercially meaningful solutions • Help make Data Hub an AI-agent-forward platform
• Train, fine-tune, optimize and customize perception DNNs in low precision (FP16/INT8) • Apply sophisticated quantization of DNNs • Improve DNN architectures using ML algorithms on NVIDIA GPUs or DLAs • Continuously improve inference speed, accuracy and power consumption of DNNs • Stay up to date with the latest research and innovations in deep learning, implement and experiment with new insights to improve NVIDIA's automotive DNNs.




