3 ms·
Aren't there any "blind" benchmarks?
by amelius 2y ago
Aren't there any "blind" benchmarks?
- nathanasmith 2y agoUnfortunately that wouldn't help as much as you think since talented AI labs can just watch the public leaderboard and note what models move up and down to deduce and target whatever the hidden benchmark is testing.
- nickthegreek 2y agoOpenRouter Arena Ratings are probably the closet thing.