4 ms·
Come on, you can do the critical thinking here to understand why these companies would want the best in class (open/closed) weight LLMs.
by fullshark 2y ago
Come on, you can do the critical thinking here to understand why these companies would want the best in class (open/closed) weight LLMs.
- seydor 2y agothen why would they cheat?
- fullshark 2y agoWell we'll see if they suffer consequences of this and they cheated too hard, but being perceived as best in class is arguably worth even more than being the best in class, especially if differences in performance are hard to perceive anecdotally. The goal is long term control over a technology's marketshare, as winner take all dynamics are in play here.
- baby 2y agothey're all cheating, see grok
- nomel 2y agoAre you referring to this [1]? > Critics have pointed out that xAI’s approach involves running Grok 3 multiple times and cherry-picking the best output while comparing it against single runs of competitor models. [1] https://medium.com/@cognidownunder/the-hype-machine-gpt-4-5-vs-grok-3-and-the-reality-behind-ai-benchmark-wars-8f287c56753c https://medium.com/@cognidownunder/the-hype-machine-gpt-4-5-...
- SubiculumCode 2y agoI didn't see evidence of cheating in the article. Having a slightly differently tuned version of 4 is not the most dastardly thing that can be done. Everything else is insinuation.