#flaky-evals

Your Research Agent Passed the Eval Once. Run Every Case Five Times and Grade the Worst Run.

A single green run tells you the agent can do the task, not that it will. Repeat each eval case, split the suite into solid, flaky and broken, and the flaky bucket becomes your real to-do list.