3 ms·
I've tested GLM 5.3 on the release day and Artificial Analysis is spot on. It's a really good model. But my main takeaway was something else. I've used closed
by glub 2mo ago
I've tested GLM 5.3 on the release day and Artificial Analysis is spot on. It's a really good model.
But my main takeaway was something else. I've used closed weight models for long enough that I've forgotten how good it feels to see reasoning tokens.
With GPT/Claude, you kind of hope that intent was captured well, that agent had all the information, all the tools it needed, because you won't see "hmmm it seems like nix flake isn't available here and I shouldn't install something globally" until it slopped out millions of tokens and wasted hundreds of dollars for 8 hours. With GLM and the likes, you just stop the disease right where it begins.
- Havoc 2mo agoYes, not necessary often but being able to stop something that is going off the rails is super useful. Especially if the root cause is prompt ambiguity - inject a clarification & it recovers
- glub 2mo agoIt's also starting to go beyond reasoning and it's becoming much more problematic. Reasoning is one thing, but codex, for example now encrypts agent-to-agent messages as well, and compaction. I've no idea what subagents are instructed to do, or what they reported back in native codex. The only thing that's keeping me is the value $200 subscription provides. If that value disappears, I see no reason why not to switch to something that isn't a black box.
- tw1984 2mo agoWith GPT/Claude, hiding those from users to waste their tokens is a feature, not a limitation.
- aitchnyu 2mo agoGenerally, are closed sourced models hiding their traces? I was making an agent to develop and deploy apps and fed the traces to dispel time-consuming detours and made it a few times faster.