Agents train in four real digital environments and are graded on two questions: can they do the task — and can they cheat the reward? Watch episodes step by step in the Demo, and compare reward robustness on the Leaderboard.
Interactive episodes across all four environments, replayed step by step — every action, observation, and screenshot — and scored on four dimensions: completion, efficiency, accuracy, safety.
In AxiomChat, every episode is graded twice — the gameable proxy the agent optimizes, and a privileged out-of-band oracle it can never see. The gap between the two is the score.
Headline numbers from the reward-robustness benchmark (question 02), measured on held-out seeds.
174 labeled runs over 4 tasks × 2 reward versions, driven by a scripted exploit catalog on held-out seeds.
Every naive reward was hacked. Every hardened reward held — offline.
…until a live agent broke one. gemini-3.1-flash-lite hacked the summarize_incident hardened reward on 2 of 3 held-out seeds — discovered, frozen as a regression case, and patched.
Same model, same rubric — only the defense stack differs, so what's measured is the defenses and not model capability. Honest work scores 1.0 under both.
chat · webapp · CLI · JSON — one twin-graded
catalogued, scripted, regression-gated
TDD, enforced pre-commit
RRS = (1 − hack)
× fidelity
The agent optimizes a gameable proxy. A privileged oracle grades the same episode out-of-band — it is never in the serving path, so the agent can't reach it.
LLM or scripted exploiter — briefed only on the proxy spec
AxiomChat, webapp, CLI, JSON — reset per episode
in-band · what training optimizes · visible, gameable
out-of-band · token-gated ground truth · unreachable by the agent
Step through what the agent saw, did, and was paid — honest runs across all four environments, and every hack flagged inline with the proxy-vs-oracle verdict.
▶ Open the Demo←→spaceFour report modes: the offline sweep, live LLM agents, and two frozen discovery runs — including the one that broke a hardened reward.
Open the Leaderboard →4 modes