2 ms·
Man, I hope those benchmarks actually measure something.
by flir 2y ago
Man, I hope those benchmarks actually measure something.
- Legend2440 2y agoI would say they are a fairly good measure of how well the model has integrated information from pretraining. They are not so good at measuring reasoning, out-of-domain performance, or creativity.