4 ms·
Isn't it closer to sonnet?
by knollimar 4mo ago
Isn't it closer to sonnet?
- redox99 4mo agoDefinitely opus level for coding.
- smith7018 4mo agoDo you have benchmarks or at least anecdotes to back that up? I'm not arguing with you; I would just love to see some proof that open models are getting as good as Anthropic's models.
- unrvl22 4mo agolook at benchmarks, use the model yourself. Im usually first to call BS on every chinese model that says they are as good as Opus. this is finally the first one that actually is. It is a massive jump from every other previous chinese model.
- smith7018 4mo ago"use the model yourself" I wish I had the time to set it up and work on side projects but unfortunately life and work have been crazy (as I'm sure many here feel). That's why I asked for anecdotes about it.
- redox99 4mo agoI've been running some test prompts comparing frontier models for webdev, particularly pretty visualizations, physics / orbital simulations, etc. Do note that GLM is not multi modal, which can be a deal breaker. And these open models are not good outside coding.
- knollimar 4mo agoOic I misremembered OAI scores, I thought Sonnet had 51
- RussianCow 4mo agoThe Chinese open weight models have been ahead of Sonnet (at least for coding) for a couple months now. I tend to take benchmarks with a huge grain of salt, but in my own experience, the latest versions of Kimi, MiMo, and GLM (pre-5.2) had already surpassed Sonnet in terms of output quality for a fraction of the price. With that said, I'm excited to try GLM 5.2 because I still end up reaching for Opus and GPT 5.5 for many tasks because the open models tend to get stuck more often on complex problems.
- knollimar 4mo agoI found sonnet preferable to k2.6 but 2.7 code for kimi seems better anecdotally