3 ms·
The latter is a joke
by m00dy 3mo ago
The latter is a joke
- user43928 3mo agoI saw that it runs GPQA Diamond and TAU-Bench Airline and shows the results over a 32 day rolling average. Other than that they track Tool call error rate and Structured output error rate. I only discovered this today, and it seems like a good idea. What are the problems in practice?