3 ms·
If you don't spend any time comparing models to the point where you don't know about benchmarks, why do you care where people think the line for SOTA is?
by scottyah 7mo ago
If you don't spend any time comparing models to the point where you don't know about benchmarks, why do you care where people think the line for SOTA is?
- mikkupikku 7mo agoThe benchmark game is wholly gamed, but the proof is in the pudding. I know people using Anthropic, OpenAI, and Gemini. Chinese models locally. But who uses Grok for anything but porn? Whatever the benchmarks might say, Grok is just trash in practice. They spent too much time teaching it to be edgy and not enough time teaching it to code.
- scottyah 7mo agoOk, sounds like you're already mentally set
- mikkupikku 7mo agoSounds like you've got nothing to say for Grok besides meaningless benchmarks.