ML Systems Engineer, GPU Performance (Seed-Stage AI Infrastructure)
ScrumAID
Listing collected from ScrumAID's career site. NextChapter is independent of ScrumAID.
San Jose, CA · Posted November 1, 2026
Will your résumé get you an interview here?
Drop your résumé and see in seconds how well it matches what ScrumAID asks for. Free, no account needed.
Just laid off? Start here: a plan for the first weeks
More in California job market · Technology & Software · Data & Analytics jobs
More roles at ScrumAID
- EDA Characterization Engineer (Chip-Design Software Startup) · San Francisco, CA
- Customer Solutions Engineer (B2B Software Startup) · San Francisco, CA
- Mechanical Design Engineer (Robotics for Data Centers) · San Francisco, CA
- Electrical Engineer II, Spacecraft Power (Space Startup) · Los Angeles, CA
- Executive Assistant to the CEO, Social Content (Fusion and Defense Tech) · San Francisco, CA
- Full-Stack Engineer, Backend-Leaning (AI Agent Tooling) · San Francisco, CA
Similar jobs
- Senior / Staff AI Research Engineer, Real-Time Inference · RoboForce · Milpitas, CA
- Senior AI Agent Engineer · Liberate · San Francisco, CA
- AI/ML Software Engineer · iTradeNetwork · CA
- Lead AI Native Engineer · RoboForce · Milpitas, CA
- Staff AI Agent Engineer · Liberate · CA
- AI Enablement Lead · Firecrawl · San Francisco, CA
Where San Jose, CA ranks
Where San Jose, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for aerospace and defense pay after cost of living$187k · of 19
- #2Best cities for marketing pay after cost of living$121k · of 16
- #3Best cities for software and engineering jobs in the West Coast1,201 openings · of 59
- #5Best cities for software and engineering jobs1,201 openings · of 100
- #5Best cities for product jobs170 openings · of 22
- #5Best cities for technology jobs1,964 openings · of 100
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,904 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($184k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
About the job
A seed-stage startup is rebuilding the software that trains and serves generative world models, working from GPU kernels all the way up to multi-node serving. The engineer joining owns how fast and how efficiently the whole stack runs, alongside founders who bring experience in distributed systems, kernels, cloud and research.
Your scope
Tune GPU and system performance for training and inference of imagery, video and world models
Hunt down bottlenecks across kernels, memory, hosts and clusters with profilers such as Nsight
Hand-write performance-critical code in CUDA and Triton
Create and refine distributed engines for serving and training diffusion models
Own speed of communication between GPUs and nodes, covering NCCL, RDMA over InfiniBand or RoCE, and split-stage (disaggregated) inference serving
Create benchmark and regression suites that keep speedups from eroding in production
Co-design kernels, runtime and models with the underlying hardware in mind
Who fits
At least two years working on deep learning inference or training systems and distributed systems
Authored core functionality inside an inference or training framework such as vLLM, SGLang, TensorRT-LLM or Megatron
Hands-on kernel development on NVIDIA GPUs with CUDA, CUTLASS, Triton or PTX
Strong ML and computer science fundamentals, with a degree in CS or a related quantitative discipline
Optimizing diffusion, video, image or other multimodal models is a plus
On-site in the South Bay Area of Silicon Valley. Visa transfers and new sponsorships are both possible.