3 ms·
Maybe but I don't see how this release would support that conclusion- their 72B model surpasses Llama 3 70B on so many metrics by such a wide margin I find it a
by causal 2y ago
Maybe but I don't see how this release would support that conclusion- their 72B model surpasses Llama 3 70B on so many metrics by such a wide margin I find it a little hard to believe.
- segmondy 2y agothat benchmark is by then, the community has to evaluate and report back. I never believe self reported benchmarks.
- moffkalast 2y agoYeah the arena leaderboard will show where it really goes in a week or two.
- irthomasthomas 2y agoArena lets you use 1k out of those 128k available tokens. It's not a good test.
- moffkalast 2y agoWell they only have so much compute right? Beats the usual multiple choice, one token output benchmarks.
- causal 2y agoIt's a human-preference benchmark. Useful but not sufficient.