← Search all jobs

Lead Software Engineer

Searchability

New York · Posted October 14, 2026

See every open role at Searchability

More in New York job market · Technology & Software · Engineering jobs

Pay compared with the market

This listing does not state pay. Across 61 open lead software engineer listings that state pay, the middle half runs $170,000 to $192,500 and the median is $186,000.

Listed pay is what employers advertise, not what people are paid.

Lead Software Engineer salaries by state · Check your own pay

About the job

Lead Rust Engineer

NYC Start-up changing the way LLM’s are utilized!

Up to $300k + Equity

On-Site – New York

Rust, Machine Learning, Reinforcement Learning, LLM

ABOUT THE CLIENT

A New York based start-up who are changing the way LLMs are utilized and scaled! They’re building a world class ML infrastructure product that is already changing the way businesses incorporate ML.

The product has applications across a multitude of industries to drive their LLM’s to rapidly improve their capabilities.

THE LEAD RUST ENGINEER

We’re hiring a founding engineer with deep systems chops (Rust especially) to help build a fast, flexible model gateway at the heart of our AI infrastructure. Most of your work will be open source, with projects ranging from inference-time optimization to real-time experimentation tools. You’ll have the freedom to dive deep into what you already know or pick up entirely new skills as we scale. If building core ML infrastructure in the open sounds like your kind of challenge, we’d love to talk.

SKILLS:

RUST

SYSTEMS ENGINEERING

PhD Education

ML

LLM

TO BE CONSIDERED:

Please either apply by clicking online or emailing me directly james.roberts@searchability.com. I can make myself available outside of normal working hours to suit between 7am until 8pm. If unavailable, please leave a message and either myself or one of my colleagues will respond. By applying for this role, you give express consent for us to process and submit (subject to required skills) your application to our client in conjunction with this vacancy only. Also feel free to follow me on twitter @searchablejim or connect with me on LinkedIn! I look forward to hearing from you.

KEY SKILLS

RUST , SYSTEMS ENGINEERING , ML , MACHINE LEARNING / MLOPS / LLM / LARGE LANGUAGE MODELS