3 ms·
Yeah the arena leaderboard will show where it really goes in a week or two.
by moffkalast 2y ago
Yeah the arena leaderboard will show where it really goes in a week or two.
- irthomasthomas 2y agoArena lets you use 1k out of those 128k available tokens. It's not a good test.
- moffkalast 2y agoWell they only have so much compute right? Beats the usual multiple choice, one token output benchmarks.
- causal 2y agoIt's a human-preference benchmark. Useful but not sufficient.