3 ms·
Half of the benchmarks don't have published answers. That's why training data providers have been hiring physicists to solve them.
by fsh 10d ago
Half of the benchmarks don't have published answers. That's why training data providers have been hiring physicists to solve them.
- deleted 10d ago[deleted]
- red75prime 10d agoThis is unconventional benchmaxxing then, when they decrease the benchmark scores to allow models to generalize on correct solutions.