3 ms·
>> Llama 3.3 70B and Qwen 2.5 72B are certainly comparable to GPT-4 > I'm skeptical; the llama 3.1 405B model is the only comparable model I've used, and it's
by PhilippGille 2y ago
>> Llama 3.3 70B and Qwen 2.5 72B are certainly comparable to GPT-4
> I'm skeptical; the llama 3.1 405B model is the only comparable model I've used, and it's significantly larger than the 70B models you can run locally.
Every new Llama generation achieved to beat larger models of the previous generation with smaller ones.
Check Kagi's LLM benchmark: https://help.kagi.com/kagi/ai/llm-benchmark.html https://help.kagi.com/kagi/ai/llm-benchmark.html
Check the HN thread around the 3.3 70b release: https://news.ycombinator.com/item?id=42341388 https://news.ycombinator.com/item?id=42341388
And their own benchmark results in their model card: https://github.com/meta-llama/llama-models/blob/main/models%2Fllama3_3%2FMODEL_CARD.md https://github.com/meta-llama/llama-models/blob/main/models%...
Groq's post about it: https://groq.com/a-new-scaling-paradigm-metas-llama-3-3-70b-challenges-death-of-scaling-law/ https://groq.com/a-new-scaling-paradigm-metas-llama-3-3-70b-...
Etc
- int_19h 2y agoThey still do not beat GPT-4, however. And benchmarks are very misleading in this regard. We've seen no shortage of even 8B models claiming that they beat GPT-4 and Claude in benchmarks. Every time this happens, once you start actually using the model, it's clear that it's not actually on par.
- simonw 2y agoGPT-4 from March 2023, not GPT-4o from May 2024.