4 ms·
I don't get it. My husband also swears by Clause Sonnet 3.5, but every time I use it, the output is considerably worse than GPT-4o
by skerit 2y ago
I don't get it. My husband also swears by Clause Sonnet 3.5, but every time I use it, the output is considerably worse than GPT-4o
- Zealotux 2y agoI don't see how that's possible. I decided to give GPT-4o a second chance after reaching my daily use on Sonnet 3.5, after 10 prompts GTP-4o failed to give me what Claude did in a single prompt (game-related programming). And with fragments and projects on top of that, the UX is miles ahead of anything OpenAI offers right now.
- lostmsu 2y agoJust don't listen to anecdata, and use objective metrics instead: https://chat.lmsys.org/?leaderboard https://chat.lmsys.org/?leaderboard
- PhilippGille 2y agoYou might also want to look into other benchmarks: https://old.reddit.com/r/LocalLLaMA/comments/1ean2i6/the_final_straw_for_lmsys/ https://old.reddit.com/r/LocalLLaMA/comments/1ean2i6/the_fin...
- usaar333 2y agoGPT-4o being only 7 ELO above GPT-4o-mini suggests this is measuring something a lot different than "capabilities".
- Chilko 2y agoAnecdata seems quite valid for LLM comparison when trying to evaluate 'usefullness' for users. The lmsys chat leaderboard is literally just mass anecdata.
- lostmsu 2y agoYes, "mass anecdata" + blind collection is usually called "data".