Site Reliability Engineer
Mistral AI
New York, NY · Posted October 27, 2026
Just laid off? Start here: a plan for the first weeks
See every open role at Mistral AI
More in New York job market · All Site Reliability Engineer jobs (164) · Technology & Software · Engineering jobs
More roles at Mistral AI
- Engineering Manager, Inference
- AI Deployment Strategist - USA · Palo Alto, CA
- Research Engineer, ML Platform · Palo Alto, CA
- Technical Program Manager, Science Operations, Code · Palo Alto, CA
- Partner Manager Lead – NVIDIA · Palo Alto, CA
- Research Engineer, Code Agents Infra · Palo Alto, CA
Similar jobs
- Software Engineer, Credit · Ramp · New York, NY
- Software Engineer, Developer API · Ramp · New York, NY
- Senior Software Engineer - Archer · Manufacturers and Traders Trust Company · Buffalo, NY
- Lead Software Engineer - Mainframe · Manufacturers and Traders Trust Company · Buffalo, NY
- Java/Python Sr Software Engineer · Ameriprise Certificate · New York, NY
- Embedded Software Engineer, SR · Curtiss Wright · NY
Where New York, NY ranks
Where New York, NY placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for operations jobs1,429 openings · of 100
- #1Best cities for sales jobs2,774 openings · of 78
- #1Best cities for finance jobs1,932 openings · of 78
- #1Best cities for data and analytics jobs1,713 openings · of 58
- #1Best cities for HR jobs994 openings · of 30
- #1Best cities for marketing jobs1,754 openings · of 31
Rankings about engineering jobs
- Best cities for software and engineering jobs #1 San Francisco (3,412 openings)
- Best cities for engineering pay after cost of living #1 San Mateo ($216k)
- Most requested AI skills in engineering jobs #1 AI tools in daily work (6.1%)
- AI tools named most often in engineering jobs #1 Claude (1.7%)
- Employers with the most engineering jobs #1 Amazon (2,992 roles)
Pay compared with the market
This listing does not state pay. Across 61 open site reliability engineer listings that state pay, the middle half runs $122,500 to $171,500 and the median is $147,500.
Listed pay is what employers advertise, not what people are paid.
Site Reliability Engineer salaries by state · Check your own pay
How AI is used in this kind of work
Among software developers, AI is already used for some of the tasks. Measured exposure for software developers: 29% (some).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
About Mistral
Mistral provides full-stack AI solutions: from frontier models to developer tools, applications, and compute. We partner with enterprises tackling the hardest problems across high-stakes industries like finance, manufacturing, defense, healthcare, and the public sector, co-creating customized AI systems that they can run on their terms.
We are a dynamic, collaborative team passionate about AI and its potential to transform society. Our diverse workforce thrives in competitive environments and is committed to driving innovation. Our teams are distributed between Europe, North America, Asia and the Middle East. We are creative, low-ego and team-spirited.
The Role
We are seeking highly experienced Site Reliability Engineers (SRE) to shape the reliability, scalability and performance of our platform and customer facing applications. You will work closely with our software engineers and research teams to ensure our systems meet and exceed our internal and external customers' expectations.
What You Will Do
As a Site Reliability Engineer, you balance the day-to-day operations on production systems with long-term software engineering improvements to reduce operational toil and foster the reliability, availability, and performance of these systems.
Operations
• Design, build, and maintain scalable, highly available and fault-tolerant infrastructures to support our web services and ML workloads
• Make sure our platform, inference and model training environments are always highly available and enable seamless replication of work environments across several HPC clusters
• Operate systems and troubleshoot issues in production environments (interrupts, on-call responses, users admin, data extraction, infrastructure scaling, etc.)
• Implement and improve monitoring, alerting, and incident response systems to ensure optimal system performance and minimize downtime
• Implement and maintain workflows and tools (CI/CD, containerization, orchestration, monitoring, logging and alerting systems) for both our client-facing APIs and large training runs
• Participate occasionally in on-call rotations to respond to incidents and perform root cause analysis to prevent future occurrences
Development
• Drive continuous improvement in infrastructure automation, deployment, and orchestration using tools like Kubernetes, Flux, Terraform
• Collaborate with AI/ML researchers to develop and implement solutions that enable safe and reproducible model-training experiments
• Build a cloud-agnostic platform offering an abstraction layer between science and infrastructure
• Design and develop new workflows and tooling to improve to the reliability, availability and performance of our systems (automation scripts, refactoring, new API-based features, web apps, dashboards, etc.)
• Collaborate with the security team to ensure infrastructure adheres to best security practices and compliance requirements
• Document processes and procedures to ensure consistency and knowledge sharing across the team
• Contribute to open-source projects, research publications, blog articles and conferences
What We're Looking For
• Master’s degree in Computer Science, Engineering or a related field
• 7+ years of experience in a DevOps/SRE role
• Strong experience with cloud computing and highly available distributed systems
• Exposure to site reliability issues in critical environments (issue root cause analysis, in-production troubleshooting, on-call rotations...)
• Experience working against reliability KPIs (observability, alerting, SLAs)
• Hands-on experience with CI/CD, containerization and orchestration tools (Docker, Kubernetes...)
• Knowledge of monitoring, logging, alerting and observability tools (Prometheus, Grafana, ELK Stack, Datadog...)
• Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
• Proficiency in scripting languages (Python, Go, Bash...) and knowledge of software development best practices
• Strong understanding of networking, security, and system administration concepts
• Excellent problem-solving and communication skills
• Self-motivated and able to work well in a fast-paced startup environment
Your application will be all the more interesting if you also have:
• experience in an AI/ML environment
• experience of high-performance computing (HPC) systems and workload managers (Slurm)
• worked with modern AI-oriented solutions (Fluidstack, Coreweave, Vast...)
What We Offer
We offer a comprehensive benefits package designed to support your well-being, growth, and work-life balance. Benefits vary by country and may include healthcare coverage, parental leave, retirement plans, relocation support, wellness programs, meal and transportation allowances, and other location-specific perks.
For the most up-to-date details on benefits available in your location, please refer to our Benefits page .
Privacy Policy
Your privacy matters to us. You can learn more about how we handle your personal data in our Applicant Privacy Policy .