← Search all jobs

AI Agent Engineer, Evaluation and Reliability (Semiconductor AI)

ScrumAID

San Jose, CA · Posted November 1, 2026

Just laid off? Start here: a plan for the first weeks

More in California job market · Technology & Software · Data & Analytics jobs

More roles at ScrumAID

Similar jobs

Where San Jose, CA ranks

Where San Jose, CA placed in our monthly rankings, month by month. Each month stays online at its own address.

How AI is used in this kind of work

Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).

Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.

Check how this applies to your own job

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

About the job

A fast-growing AI company that builds software agents for semiconductor and hardware engineering is hiring engineers to make those agents stronger, more dependable and cheaper to run. The role blends talking with customers, designing evaluations, applied research and production engineering, alongside software engineers, researchers and hardware specialists.

Your focus

Identify where agents fail, then build and execute evals that improve quality, reliability and efficiency

Create new agent capabilities: interfaces to tools, handling of context, memory, and orchestration across several steps or several agents

Examine run traces and test outcomes to pinpoint slowdowns, and distinguish true progress from benchmark noise

Talk with customers and subject specialists about their needs, then ship and maintain solutions through to completion

Turn experiments that work into solid, maintainable software in production

Profile

Five to fifteen years of software engineering, including work on large-scale agent systems

Strong production skills in Python and TypeScript

Working knowledge of current language models, agent frameworks and typical ML workflows

Experience with LLM agent orchestration, tools, memory and tracing

Communicates well, shows sound judgment about customers and can isolate the core of vague technical problems

Self-directed with strong ownership and product sense

Bonus: interest in chip design or systems that span hardware and software

On-site in the South Bay Area (Silicon Valley). Not able to offer visa sponsorship or transfers.