> IMHO llama 3.1 405B does not fit the definition, and the actual model quality is far from the benchmarks Very true. Meta has been disappointing so far, and i

> IMHO llama 3.1 405B does not fit the definition, and the actual model quality is far from the benchmarks Very true. Meta has been disappointing so far, and it takes away from the blog that it starts with a graph of a completely misrepresentative benchmark (MMLU) that shows things like Llama3.1-405b besting Gemini 1.5-pro, 4o-mini above Haiku 3.5, and so on. But all this means is that the leap in terms of open weights model is even far bigger with Deepseek v3.