3 ms·
"Benchmarks" for LLMs are a total hoax, since you can train them on the benchmarks themselves.
by andrepd 10mo ago
"Benchmarks" for LLMs are a total hoax, since you can train them on the benchmarks themselves.
- XCSme 10mo agoI would assume a good benchmark has hidden tests, or something randomly generated that is harder to game