DDN logo
DDN

World’s leading Data Intelligence Platform supercharging over 500,000 GPUs across all data workloads

Senior Staff Engineer - AI Data Path

Full-stack EngineerSoftware EngineerFull TimeRemoteLeadTeam 1,001-5,000Since 1998H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

3 days ago

Salary

0

Seniority

Lead

Job Description

Senior Staff Engineer - AI Data Path

DDN

Role Description DDN is seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage to lead hands-on development and integration of advanced storage systems with next-generation AI inference pipelines. This role involves coding, prototyping, and rapidly iterating on solutions in close collaboration with architects to design and deliver high-performance data movement architectures. - Leverage NVIDIA’s NIXL (Inference Transfer Library) alongside the Infinia Data Intelligence Platform to enable ultra-low-latency, high-throughput data movement across GPU, memory, and distributed storage layers. - Involve workloads including KV cache management and vector database retrieval. - The ideal candidate brings deep expertise in distributed storage, GPU data paths, and large-scale system optimization, with a proven track record of building and shipping production-grade AI infrastructure. Qualifications - Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. - 12+ years of experience in storage systems, distributed systems, or performance engineering. - Proven track record of architecting and delivering large-scale, high-performance infrastructure systems. - Deep expertise in distributed storage architectures (object storage, scalable file systems, or cloud-native storage platforms). - Strong understanding of Linux I/O stack, filesystem internals, and storage protocols. - Extensive hands-on experience with NVMe, SSD optimization, and high-performance storage environments. - Strong experience with RDMA, InfiniBand, or other high-speed data transfer technologies. - Solid understanding of GPU computing concepts and CPU–GPU data movement patterns. - Proficiency in Python and/or C/C++, with advanced debugging, profiling, and performance tuning skills. - Demonstrated ability to optimize latency-sensitive, high-throughput production systems. Requirements - Lead the design and implementation of high-performance data movement pipelines using NVIDIA NIXL across GPU, CPU, and storage tiers. - Architect and drive integration of DDN Infinia with GPU-accelerated inference platforms for large-scale, real-time AI workloads. - Own end-to-end optimization of I/O paths between GPU memory and storage using technologies such as NVIDIA GPUDirect Storage, RDMA, and NVMe-over-Fabrics. - Define and implement multi-tier storage architectures (NVMe, SSD, object storage) optimized for inference latency, throughput, and scalability. - Lead development of advanced KV cache management strategies, including offloading, prefetching, and persistence across distributed storage layers. - Partner with AI/ML engineering teams to optimize inference performance in frameworks such as PyTorch and TensorFlow. - Establish benchmarking frameworks and lead performance tuning efforts for storage and data movement in production inference environments. - Diagnose and resolve complex system bottlenecks across storage, networking, and GPU subsystems. - Influence architecture decisions for distributed inference systems, ensuring scalability, resilience, and efficient data locality. - Drive engineering excellence through best practices in observability, performance monitoring, automation, and reliability engineering. - Mentor junior engineers and provide technical leadership across cross-functional teams. Preferred Skills - Hands-on experience with NVIDIA NIXL or similar data movement frameworks. - Experience with GPU-aware storage pipelines and GPUDirect Storage. - Strong understanding of AI inference systems, LLM serving architectures, and KV cache optimization. - Experience with Retrieval-Augmented Generation (RAG) pipelines and open vector search ecosystems. - Background in high-performance computing (HPC) or hyperscale distributed environments. - Expertise in caching strategies, memory tiering, and data locality optimization. - Experience designing disaggregated compute and storage architectures. What You’ll Work On - Leading the evolution of storage systems into GPU-native data layers for AI inference. - Building next-generation distributed AI infrastructure using NIXL and Infinia. - Driving performance breakthroughs in real-time LLM inference at scale. - Designing storage architectures for large-scale AI datasets and retrieval systems.

Related Job Pages

More Full-stack Engineer Jobs

CVS Health logo

Senior Software Engineer

CVS Health

CVS Health is a leading healthcare company operating CVS Specialty, CVS Pharmacy, CVS MinuteClinic, and CVS Caremark. In 2018, CVS combined forces with healthca

• Monitor application performance, system health, and alerts using APM tools such as AppDynamics, Grafana, and Splunk • Act as the primary point of contact for incident management and service requests • Conduct initial triage, classify issues, and prioritize tickets in alignment with SLAs and SLIs • Resolve routine issues by leveraging runbooks and established standard operating procedures • Escalate complex incidents to L2/L3 support teams with comprehensive documentation • Provide timely communication on incident status, updates, and resolutions to stakeholders and end users • Work within REST APIs, microservices-based architectures, and cloud platforms (AWS, Azure, GCP) • Troubleshoot and debug SQL queries across relational and non-relational databases • Support CI/CD pipelines and assist with deployment-related troubleshooting • Automate repetitive operational activities using scripting languages such as Python and Shell • Maintain, update, and enhance runbooks, knowledge repositories, and SOPs • Perform in-depth troubleshooting across applications, APIs, and underlying infrastructure • Analyze logs, metrics, and traces to identify and resolve root causes • Debug application issues at the code level (preferably in Java, Python, or similar technologies) • Implement data corrections, configuration changes, and minor code or script updates • Collaborate with engineering teams to deploy bug fixes, enhancements, and patches • Participate in post-incident reviews and contribute to root cause analysis (RCA) initiatives

Texas
$92.7K - $185.4K / year
Imagemaker logo

Líder Técnico – CAM

Imagemaker

Let’s co-create awesome digital experiences!

Full TimeRemoteTeam 201-500Since 2003H1B No Sponsor

• Liderar técnicamente al equipo, promoviendo buenas prácticas de desarrollo y arquitectura. • Tomar decisiones técnicas considerando calidad, escalabilidad y necesidades del negocio. • Comunicar de forma clara y efectiva con equipos técnicos y no técnicos. • Mentorear y desarrollar el talento del equipo mediante acompañamiento y retroalimentación. • Fomentar la colaboración, el trabajo en equipo y la resolución constructiva de conflictos. • Guiar revisiones de código y asegurar el cumplimiento de estándares de calidad. • Resolver problemas complejos y liderar la atención de incidentes con enfoque en la causa raíz. • Planificar, priorizar y dar seguimiento a las iniciativas técnicas del equipo. • Impulsar la mejora continua, la innovación y la adopción de nuevas tecnologías y prácticas. • Actuar con proactividad, liderazgo, responsabilidad y orientación a resultados.

Chile
Common App logo

Software Engineering Team Lead

Common App

We are dedicated to access, equity, and integrity in the college admission process.

Full TimeRemoteTeam 51-200Since 1975H1B No Sponsor

• Reports to our Senior Director, Software Engineering. • Part of a team of engineers designing and developing both web-based and mobile software products for Common App. • Provides technical guidance and mentors a team of Software Developers. • Implements high quality software products that meet the needs of The Common Application community.

Virginia
$135K - $149.0K / year
Go RH logo

Développeur Full Stack

Go RH

L'humainement possible

Full TimeRemoteTeam 51-200H1B No Sponsor

• Concevoir et développer de nouvelles fonctionnalités robustes de A à Z (architecture, backend, frontend) pour la plateforme Horizon • Participer activement à l'architecture logicielle et aux décisions techniques • Assurer l'intégration avec d'autres systèmes et préparer la plateforme à une mise à l'échelle • Prendre en charge la qualité du code en effectuant des tests rigoureux et des revues de code constructives • Collaborer étroitement avec le Product Manager et le Designer UX/UI

Canada