Some, like TerminalBench-2.0, requires web access for some tasks. If agents are expected to be use the web as a tool productively, which is a very useful SWE s

Some, like TerminalBench-2.0, requires web access for some tasks. If agents are expected to be use the web as a tool productively, which is a very useful SWE skill, they should be evaluated with that setting. Otherwise you risk behavior drift from the agent you are actually shipping