4 ms·
Coding agents work well enough to be useful because they can check their own work. Nevertheless it is too generous to call that reasoning. If they're right 80%
by Zigurd 8mo ago
Coding agents work well enough to be useful because they can check their own work. Nevertheless it is too generous to call that reasoning. If they're right 80% of the time and they rerun a prompt if the project won't build, they might be right 95% of the time, or even 99% of the time on the third try. And if you know a bit about coding you're probably able to recognize when to intervene.
That's not to denigrate a real productivity booster. It is however a warning to anyone applying LLM-based AI to use cases where you don't have the kind of training corpus and formal framework around correctness that characterizes coding.
Coding surely matters. But it also might be a truly unique use case.
- coffeefirst 8mo agoTo an extent… that will get you a project that builds, and passes any other objective detectable test, but it can’t tell you if it’s reasonable or good. Which means we’re getting a lot of shitty work that passes tests.