3 ms·
How well do these gains transfer outside TerminalBench? I’ve seen agents do well on structured evals but fall apart once the environment becomes less constrain
by amelia-anh-lam 5mo ago
How well do these gains transfer outside TerminalBench?
I’ve seen agents do well on structured evals but fall apart once the environment becomes less constrained (messy files, ambiguous tasks, partial failures, etc.).