Note that this is the English-only leaderboard, which you have to manually select when you visit the site. Also the uncertainty on the score is still high, so i

Note that this is the English-only leaderboard, which you have to manually select when you visit the site. Also the uncertainty on the score is still high, so it may change. But this is undoubtedly the strongest open weights model of any size so far, by far. People seem to be saying that Llama 3's safety tuning is much less severe than before so my speculation is that this is due to reduced refusal of prompts rather than superior knowledge or reasoning, given the eval scores. But still, a real and useful improvement! At this rate, the 400B is practically guaranteed to dominate.