4 ms·
I have a document generation task that I used to run with 4.8. This morning after it switched to 5, the documents were consistently 30%-40% longer for the same
by vidarh 3mo ago
I have a document generation task that I used to run with 4.8. This morning after it switched to 5, the documents were consistently 30%-40% longer for the same prompt... Not evaluated whether they are actually better or worse yet, but what was interesting was how consistently more verbose it was.
- ceejayoz 3mo agoI'm sure that's entirely unrelated to the fact that they charge per token.
- vidarh 3mo agoHeh. For this specific task, if the output is the same quality or better per token output, it'd actually be positive, but I have plenty of tasks where extra verbosity would be undesirable as well, so I'll be keeping a close eye on this. Currently has Opus running a comparative test of itself against Kimi K3 on one project, and it keeps finding that Kimi is competitive for multiple stages of the pipeline, so I may well end up reducing my use overall anyway...
- hangrybear666 3mo agoReview fatigue is already draining my energy levels at work to a point where I've been using agents less because it's just not possible to be productive when I have to read hundreds of lines of markdown every couple minutes. Other people might just turn to automation blindness and click OK without verifying but I refuse to just let anthropic go rampant in my codebase.