3 ms·
They still do not beat GPT-4, however. And benchmarks are very misleading in this regard. We've seen no shortage of even 8B models claiming that they beat GPT-
by int_19h 2y ago
They still do not beat GPT-4, however.
And benchmarks are very misleading in this regard. We've seen no shortage of even 8B models claiming that they beat GPT-4 and Claude in benchmarks. Every time this happens, once you start actually using the model, it's clear that it's not actually on par.
- simonw 2y agoGPT-4 from March 2023, not GPT-4o from May 2024.