4 ms·
No, it's when a benchmark becomes a target. You might have a private benchmark that you tell no one about. Would you not trust it?
by fluoridation 2mo ago
No, it's when a benchmark becomes a target. You might have a private benchmark that you tell no one about. Would you not trust it?
- charlieyu1 2mo agoGood benchmarks are costly to build even for mid-large corporations. And once the benchmark is used on models you really can’t tell if the problems would be scrapped for training
- fluoridation 2mo agoI was speaking in general, not just about AI.
- pixl97 2mo agoAny benchmark that has a selection condition can be discovered. The more money involved, the more effort that will go into discovering said benchmark.