6 ms·
I use them. The top 3 models still write terrible code, regardless of harness. They’ll litter the code with safety checks for scenarios we’ve already guaranteed
by christophilus 26d ago
I use them. The top 3 models still write terrible code, regardless of harness. They’ll litter the code with safety checks for scenarios we’ve already guaranteed won’t happen. And they’ll solve problems you didn’t ask them to, and they’ll come up with a working, but convoluted solution. They’ll sometimes write really weird code if you’re using them in an obscure language.
Basically, they still need a human guiding them pretty closely unless you’re happy to just ship a mountain of vibe coded mush.
That said, I haven’t tried Astra in earnest yet. We’ll see in a few weeks whether or not it is a step change.