4 ms·
> It doesn’t work for the vast majority of tickets he attempts because he doesn’t have the necessary understanding to even start thinking about if the solution
by KronisLV 2mo ago
> It doesn’t work for the vast majority of tickets he attempts because he doesn’t have the necessary understanding to even start thinking about if the solution that the autocomplete generates is even remotely workable. And that’s with fancy dev loops and whatnot.
Remove the dev from the equation. Suppose you need to produce circumstances for the slop machine to succeed on its own (imagine a loop).
What is missing? A good enough description of the current behavior, desired changes and how it should work? Understanding of the business domain or the system in question, its architectural choices? Enough guardrails and linters and tests to ensure that the solution will indeed be testable and work end to end? Cause a lot of the things that will help human devs will also help LLMs make their output more workable - for example ADRs in the repo and custom in-house tools to ensure they follow architectural conventions and practices (or just something like ArchUnit). Realistically, how close to a finished implementation must you get and how far backwards from that can you go before its output degrades too much?
I tried figuring that out myself on a personal project where I mostly want what I want in GitHub issues and then feed them to Kepler, which spawns OpenCode in worktrees and also gives me a UI to follow the execution. Most models, even SOTA, occasionally implement things wrong, but it's suprising how far you can take things when you've spent a dozen hours planning out what you want the end result to be vs not to be (talking about the goals for an entire system, maybe an hour of planning for a more bounded type of task).
- jwalton 2mo agoIn general, when I’ve worked on projects where I’ve spent that much time planning, having a magic AI box that wrote perfect code wouldn’t have helped that much. When you spec every everything out like that, writing the code is the most trivial part of this whole process.
- pydry 2mo agoIf you want to make it a nontrivial mess you can get Claude to write it.
- civvv 2mo agoWhen does the intense planning just become programming in a natural language though? And at that point, it just becomes less accurate coding. I feel like this is the biggest trade off when it comes to agentic coding. You are practically trading accuracy and control for speed and efficiency. And if you want the same accuracy and control when using agents for coding, you as a validator become the bottleneck, removing in most instances all of the speed and efficiency gains. It all comes down to this, what matters the most: speed, or accuracy and control. Todays capitalism typically favours short-term thinking, speed and efficiency, which is bad news for everyone. Software developers will be forced to have less control and produce less accurate code, because the validation step is not permitted, due to it being the bottleneck.