3 ms·
Why is it wild that a LLM is as capable as a previously released LLM?
by estomagordo 8mo ago
Why is it wild that a LLM is as capable as a previously released LLM?
- simianwords 8mo agoIt means price has decreased by 3 times in a few months.
- Retr0id 8mo agoBecause Opus 4.5 inference is/was more expensive.
- crummy 8mo agoOpus is supposed to be the expensive-but-quality one, while Sonnet is the cheaper one. So if you don't want to pay the significant premium for Opus, it seems like you can just wait a few weeks till Sonnet catches up
- ceroxylon 8mo agoStrangely enough, my first test with Sonnet 4.6 via the API for a relatively simple request was more expensive ($0.11) than my average request to Opus 4.6 (~$0.07), because it used way more tokens than what I would consider necessary for the prompt.
- svachalek 8mo agoThis is an interesting trend with recent models. The smarter ones get away with a lot less thinking tokens, partially to fully negating the speed/price advantage of the smaller models.
- smartbit 8mo agoJust like humans :-) Eg a smart person will automate a task instead of executing the task repeatedly.
- estomagordo 8mo agoOkay, thanks. Hard to keep all these names apart. I'm even surprised people pay more money for some models than others.
- tempestn 8mo agoBecause Opus 4.5 was released like a month ago and state of the art, and now the significantly faster and cheaper version is already comparable.