AI Evals Engineer – Reward Design & Agent Environments
MaxIT Consulting - Max Corporate Group
San Francisco, CA · Posted November 16, 2026
No experience needed. The posting says: “The opportunity is open to exceptional new graduates, early-career engineers, and experienced senior candidates.”
Just laid off? Start here: a plan for the first weeks
See every open role at MaxIT Consulting - Max Corporate Group
More in California job market · Professional Services & Consulting · Data & Analytics jobs
More roles at MaxIT Consulting - Max Corporate Group
- Account Manager – Growth Marketing & Paid Social · New York, NY
- Agent Evaluation Infrastructure Engineer · San Francisco, CA
- Associate Product Manager, Technical – AI Platform for Life Sciences · Los Altos, CA
- Applied AI Engineer – Computer Vision & VLMs
- Backend Engineer, Applied Agents – AI Platform for Life Sciences · Los Altos, CA
- AI Agents Engineer – Python, FastAPI, RAG & Tool Calling (On-site Bay Area) · Los Altos, CA
Similar jobs
- Senior / Staff AI Engineer — Evals & Model Quality · FurtherAI · San Francisco, CA
- AI Agent Engineer (Coding Agent) · Sekai · San Francisco, CA
- AI Engineer · Tessera Labs · San Jose, CA
- AI Engineer – Decision & Optimization Systems · Gallatin · El Segundo, CA
- Senior System Engineer- AI Safety · Rhoda Ai · Mountain View, CA
- AI Engineer - Allocation and Packing Systems · Gallatin · El Segundo, CA
Where San Francisco, CA ranks
Where San Francisco, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for entry-level jobs that want AI skills35% · of 100
- #1Best cities for entry-level jobs that want AI skills in the West Coast35% · of 54
- #1Cities with the most jobs that do not need a four-year degree in the West Coast902 jobs · of 47
- #1Cities hosting the most engineering conferences18 conferences · of 27
- #1Cities hosting the most product conferences8 conferences · of 6
- #1Best cities for software and engineering jobs3,732 openings · of 100
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,904 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($184k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
About the job
San Francisco, California | Primarily On-site
We are seeking an Research Engineer – RL Infrastructure & Agent Environments to build the environments, evaluation systems, and supporting infrastructure used to train and assess long-horizon enterprise AI agents.
The Opportunity
You will work on the engineering and research problems behind realistic agent environments, post-training systems, and reliable evaluation of complex multi-step workflows.
Key Responsibilities
Design evaluation environments for long-horizon enterprise agent workflows.
Define tasks, state, tools, graders, and reward signals used to evaluate and improve agents.
Build high-fidelity representations of complex enterprise software environments.
Develop infrastructure for rollouts, orchestration, trajectory inspection, and grader pipelines.
Measure both correctness and efficiency across multi-step agent behavior.
Investigate evaluation failures, reward-quality issues, and agent behavior.
Build production-quality systems rather than notebook-only research prototypes.
Required Qualifications
Hands-on experience with AI environments, evaluations, reinforcement learning infrastructure, or related agent-training systems.
Strong software engineering fundamentals.
Demonstrated ability to build and ship technical infrastructure.
Understanding of evaluation methodology, reward design, graders, and agent trajectories.
Ability to work across languages and technology stacks based on system requirements.
Candidate Profile
A PhD is not required. Strong engineering and shipped environment or evaluation systems are more important than academic credentials or publication history.
Seniority
The opportunity is open to exceptional new graduates, early-career engineers, and experienced senior candidates. Selection is based primarily on engineering strength and relevant technical work.
Work Arrangement
The role is anchored in San Francisco with a strong preference for in-person collaboration. Limited flexibility may be considered case by case for exceptional candidates.