3 ms·
I really wish posts like this included the parameters that they were using. What model? What was the question? How many shots? Etc etc You’re going to get va
by dumbmrblah 1y ago
I really wish posts like this included the parameters that they were using. What model? What was the question? How many shots? Etc etc
You’re going to get vastly different responses if you’re using Opus versus 4o.
- siscia 1y agoDo you really? Frontier models seems remarkably similar in performance. Yeah some nuances for sure, but the whole article could apply to every model.
- arthur-st 1y ago4o on ChatGPT.com vs. Opus in an IDE is like cooking food without kitchen tools vs. using them. 4o is neither a coding-optimized model nor a reasoning model in general.
- dnh44 1y agoYou're not pushing them hard enough if you're not seeing a vast difference between 4o and Opus. Or possibly they're equivalent in the field you're working in but I suspect it's the former.
- gronglo 1y agoOpus, in my opinion, is steps away from AGI. 4o doesn't come close.
- 1over137 1y agoI’d like to know which programming language.
- dnh44 1y agoI'm of the same opinion as the op and I'm programming in Rust(api) and Swift(client) right now. I entered a vibe coded game hackathon a few months back and in a little over a week I was at 25k lines of code across both the client and server. It all worked (multiplayer) even though the game sucked.