ML Infrastructure Engineer
HSF.io
San Francisco, CA · Posted November 13, 2026
Just laid off? Start here: a plan for the first weeks
More in California job market · Technology & Software · Data & Analytics jobs
More roles at HSF.io
- Machine Learning Researcher · San Francisco, CA
- Applied AI Engineer · Los Angeles, CA
- AI Product Engineer, Clinical AI
- Engagement Lead (Client Delivery - Private Markets / Healthcare) · New York, NY
- Applied Scientist, Behavior Modeling · New York, NY
- AI Engineer · San Francisco, CA
Similar jobs
- Senior / Staff AI Engineer — Evals & Model Quality · FurtherAI · San Francisco, CA
- AI Agent Engineer (Coding Agent) · Sekai · San Francisco, CA
- AI Engineer · Tessera Labs · San Jose, CA
- AI Engineer – Decision & Optimization Systems · Gallatin · El Segundo, CA
- Senior System Engineer- AI Safety · Rhoda Ai · Mountain View, CA
- AI Engineer - Allocation and Packing Systems · Gallatin · El Segundo, CA
Where San Francisco, CA ranks
Where San Francisco, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for entry-level jobs that want AI skills35% · of 100
- #1Best cities for entry-level jobs that want AI skills in the West Coast35% · of 54
- #1Cities with the most jobs that do not need a four-year degree in the West Coast902 jobs · of 47
- #1Cities hosting the most engineering conferences18 conferences · of 27
- #1Cities hosting the most product conferences8 conferences · of 6
- #1Best cities for software and engineering jobs3,732 openings · of 100
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,904 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($184k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
Series B · ~75 people · $108M raised · Building the ingestion layer to connect human data with machines
San Francisco · In-office, full-time
About the company
The company is a Series B team in San Francisco. The CEO and CTO met at MIT. The company has raised $108M from leading investors.
The machine learning team is eight people and reports to the CTO. It runs a mix of in-house models and larger open-source ones, and an ML tech lead role is expected to be filled around the new year. Engineering is in the office five days a week in San Francisco, which is intentional at this stage.
Culture signals that hold across every role here: high agency and self-direction, no settling for 90%, and attention to detail that matters concretely. In document parsing a comma versus a period turns $20,000 into 20.000, so sloppy work is a real red flag. Engineers are expected to hold technical conversations with enterprise customers, not just stay in the code.
The role: ML Infrastructure Engineer
We are looking for an ML Infrastructure Engineer with 3+ years of experience to own and scale the training and inference stack at a fast-growing AI document processing platform. You'll be a strong generalist who understands the mechanics of how ML models work – from serving and monitoring to building robust data pipelines – and can improve inference performance, reliability, and cost efficiency. This is a high-impact IC role where you'll work closely with ML researchers to ensure models are deployed quickly and reliably, and that infrastructure is never a bottleneck for the products being served. The ideal candidate is AI-native from the get-go, comfortable with 1-to-3 node training and single-to-double node serving, and thrives in a fast-paced startup environment.
What you will be doing
Building and maintaining model serving infrastructure – improving inference speed, monitoring, and reliability to ensure it's never a bottleneck for customers
Setting up and improving training infrastructure for models ranging from 300M to 30B parameters across 1-to-3 node environments
Developing observability, logging, and monitoring systems across the ML stack
Building internal data pipelines and tooling to help ML researchers move faster from experiment to production
Architecting infrastructure to arbitrate inference between multiple cloud providers while optimizing for accuracy, latency, and cost