3 ms·
We extensively benchmark frontier models at $DAYJOB and Gemini 2.5 is the uncontested king outside of a few narrow use cases. Tracks with the rumor that Google
by gordonhart 1y ago
We extensively benchmark frontier models at $DAYJOB and Gemini 2.5 is the uncontested king outside of a few narrow use cases. Tracks with the rumor that Google has the best pretraining and falls short only in tuning/alignment. Eagerly anticipating Gemini 3 as 2.5, while king of the hill, still has lots of room for improvement!
Edit: narrow use cases are roughly "true reasoning" (GPT-5) and Python script writing (the Claudes)
- baq 1y agoI used gemini almost exclusively before gpt5, but gpt5 is much better for tool calling tasks like agentic coding and thus can handle much longer tasks unattended.
- int_19h 1y agoIf by "fall short on alignment" you mean "will shut up and do what it's told" then yes, that's true (with some forceful prompting, but much less so than what's needed with ChatGPT, never mind Claude). I would count that as a benefit, though.
- zaphirplane 1y agoThis is strange, I don’t know anyone that picks Gemini. My experience is Grok is actually the best