Senior Staff Engineer - AI Data Path
DataDirect Networks
Santa Clara, CA · $200k–$250k a year · Posted October 2, 2026
Just laid off? Start here: a plan for the first weeks
See every open role at DataDirect Networks
More in California job market · All Senior Staff Engineer jobs (85) · Technology & Software · Data & Analytics jobs
More roles at DataDirect Networks
- Staff Engineer, Lustre
- Staff Engineer
- Senior / Staff NFS Engineer
- Global Head of Benefits · New York, NY
- Senior Staff Software Engineer, S3 · Santa Clara, CA
- Staff Software Engineer, AiDP · Santa Clara, CA
Similar jobs
- Distinguished AI Engineer (Hybrid) · Cisco Systems · San Jose, CA
- Senior AI Operations Engineer · Cisco Systems · Milpitas, CA
- Sr Engineer, AI/Machine Learning · Danaher · Irvine, CA
- AI/ML Engineer - Agentic · Hewlett Packard Enterprise · San Jose, CA
- Vice President, HPC & AI GTM NA · Hewlett Packard Enterprise · San Jose, CA
- AI Engineer · East West Bank · Pasadena, CA
Where Santa Clara, CA ranks
Where Santa Clara, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for sales pay after cost of living$175k · of 45
- #1Best cities for product pay after cost of living$224k · of 14
- #2Best cities for operations pay after cost of living$173k · of 41
- #2Best cities for marketing pay after cost of living$192k · of 16
- #2Best all-round cities for remote workers in the West Coast85 / 100 · of 39
- #3Best cities for finance pay after cost of living$156k · of 35
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
Pay compared with the market
This listing pays about $225,000 a year. Across 40 open senior staff engineer listings that state pay, the middle half runs $223,000 to $265,000 and the median is $240,000. That is inside the middle half of those listings, 6% below the median.
Listed pay is what employers advertise, not what people are paid.
Senior Staff Engineer salaries by state · Check your own pay
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
DDN is seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage to lead hands-on development and integration of advanced storage systems with next-generation AI inference pipelines. This role involves coding, prototyping, and rapidly iterating on solutions in close collaboration with architects to design and deliver high-performance data movement architectures. You will leverage NVIDIA’s NIXL (Inference Transfer Library) alongside the Infinia Data Intelligence Platform to enable ultra-low-latency, high-throughput data movement across GPU, memory, and distributed storage layers, including workloads involving KV cache management and vector database retrieval. The ideal candidate brings deep expertise in distributed storage, GPU data paths, and large-scale system optimization, with a proven track record of building and shipping production-grade AI infrastructure.
KEY RESPONSIBILITIES
- Lead the design and implementation of high-performance data movement pipelines using NVIDIA NIXL across GPU, CPU, and storage tiers.
- Architect and drive integration of DDN Infinia with GPU-accelerated inference platforms for large-scale, real-time AI workloads.
- Own end-to-end optimization of I/O paths between GPU memory and storage using technologies such as NVIDIA GPUDirect Storage, RDMA, and NVMe-over-Fabrics.
- Define and implement multi-tier storage architectures (NVMe, SSD, object storage) optimized for inference latency, throughput, and scalability.
- Lead development of advanced KV cache management strategies, including offloading, prefetching, and persistence across distributed storage layers.
- Partner with AI/ML engineering teams to optimize inference performance in frameworks such as PyTorch and TensorFlow.
- Establish benchmarking frameworks and lead performance tuning efforts for storage and data movement in production inference environments.
- Diagnose and resolve complex system bottlenecks across storage, networking, and GPU subsystems.
- Influence architecture decisions for distributed inference systems, ensuring scalability, resilience, and efficient data locality.
- Drive engineering excellence through best practices in observability, performance monitoring, automation, and reliability engineering.
- Mentor junior engineers and provide technical leadership across cross-functional teams.
REQUIRED QUALIFICATIONS
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 12+ years of experience in storage systems, distributed systems, or performance engineering.
- Proven track record of architecting and delivering large-scale, high-performance infrastructure systems.
- Deep expertise in distributed storage architectures (object storage, scalable file systems, or cloud-native storage platforms).
- Strong understanding of Linux I/O stack, filesystem internals, and storage protocols.
- Extensive hands-on experience with NVMe, SSD optimization, and high-performance storage environments.
- Strong experience with RDMA, InfiniBand, or other high-speed data transfer technologies.
- Solid understanding of GPU computing concepts and CPU–GPU data movement patterns.
- Proficiency in Python and/or C/C++, with advanced debugging, profiling, and performance tuning skills.
- Demonstrated ability to optimize latency-sensitive, high-throughput production systems.
PREFERRED SKILLS
- Hands-on experience with NVIDIA NIXL or similar data movement frameworks.
- Experience with GPU-aware storage pipelines and GPUDirect Storage.
- Strong understanding of AI inference systems, LLM serving architectures, and KV cache optimization.
- Experience with Retrieval-Augmented Generation (RAG) pipelines and open vector search ecosystems.
- Background in high-performance computing (HPC) or hyperscale distributed environments.
- Expertise in caching strategies, memory tiering, and data locality optimization.
- Experience designing disaggregated compute and storage architectures.
WHAT YOU’LL WORK ON
- Leading the evolution of storage systems into GPU-native data layers for AI inference
- Building next-generation distributed AI infrastructure using NIXL and Infinia
- Driving performance breakthroughs in real-time LLM inference at scale
- Designing storage architectures for large-scale AI datasets and retrieval systems