3 ms·
Aren't there benchmarks that measure at the harness level as well?
by sanderjd 4mo ago
Aren't there benchmarks that measure at the harness level as well?
- theshrike79 4mo agoHow would you benchmark "agent harness communicates with user clearly" it's 100% a feels measurement.
- sanderjd 4mo agoI mean, in my experience some of this stuff is way closer to table stakes things than that. Like "the tool call didn't get totally confused" more than "did the communication with the user feel good".