5 ms·
Experienced senior developers can spot and fix the slop instantly, while still getting a 30x productivity gain, while entry level or junior devs basically only
by quantadev 1y ago
Experienced senior developers can spot and fix the slop instantly, while still getting a 30x productivity gain, while entry level or junior devs basically only have one "Filter" by which they determine code quality which is: "Does the code seem to work?".
Unfortunately "Slop" will appear to work enough of the time to fool a Junior.
Also the reason Junior devs get "slop" is because their prompts are "slop". They don't know all the right terminologies for things, nor do they even have the writing/language skills necessary for good prompting.
EDIT: Due to everyone checking my math I corrected this to 30x, as what's provable, from past experience.
- wizzwizz4 1y agoWhenever I can't just sit down and bash out code, it's because the design is wrong. These models are bad at design. I don't see where your 30×–50× could possibly come from.
- skydhash 1y agoMost of the times, the only reason I have the code open is to read it. If not for the huge amount of code, I could just print it out and go on my sofa. If I'm dealing with a difficult to implement algorithm, a whiteboard is a better help than bashing out code.
- quantadev 1y agoThat 30x math simply comes from spending 5min typing a prompt, and getting code generated that would take a human 2.5hrs to write. This means in the future most of a developer's time will be spent reviewing code, rather than typing it. Because AI will also be able to write the test cases too, so that effort [mostly] vanishes as well.
- wizzwizz4 1y agoUnless your job is producing disposable software (e.g. single-use mobile games for short marketing campaigns), this comment suggests you don't know how to do your job. If a piece of the program takes 5 minutes to describe, but 2½ hours to write, you're spending your time in the wrong place, producing code that's legacy almost on day 1. Quoth https://quoteinvestigator.com/2014/03/29/sharp-axe/ https://quoteinvestigator.com/2014/03/29/sharp-axe/: > The text presents to the wood cutter the alternative either to spend time in sharpening his axe, or expend his strength in using a dull one. Which shall he do? Wisdom is profitable to direct. Sure, you don't need to sharpen your axe. Given a powerful internal combustion engine, you could drive a tank through the forest and fell many trees in rapid succession. But this strategy doesn't leave you with quality lumber, and leaves a huge mess for whoever comes after you (which may be your future self), and one day there won't be any trees left. If your job is producing disposable software, be aware that you're using unpaid labour to do so. Some of the programmers who produced that AI's training data are struggling to eat and keep a roof over their heads. Act accordingly.
- quantadev 1y agoThe 5min example is like a maximum/extreme case, yes. My average time spent writing each prompt is probably 30 seconds or less, and coding time saved per prompt like 25 to 60 minutes. When I do spend minutes (not seconds) writing prompts, it's because I'm actually typing a "Context File" which describes with full clarity certain aspects of my architecture that are relevant to an Agent task set. This context file might have constraints and rules I want the Agent to follow; so I type it once and reference it from like 10 to 20 prompts perhaps. I also keep the prompt files as an archive for the future, so I can always go back and see what my original thoughts were. Also the context files help me do system documentation later.
- khuey 1y agoI've worked with some pretty smart people in my career and I've never met anyone who could do "instant" code review.
- skydhash 1y agoActual code review is very slow. More often than not, you just looking for glaring mistakes, not that the code actually respect the specifications. Which results in the LGTM comment. Because you trust the other person's experience. In very critical system, change is very slow to get in.
- dambi0 1y agoRuling out or refining an approach on the grounds it’s unlikely to lead to a suitable outcome (fixing and removing slop) is not the same as saying this code or approach represents a good enough outcome given what we currently know about the constraints of the problem (code review)
- quantadev 1y agoThe "instant" to which you refer was meaning that I can tell instantly if the LLM generated what I wanted or not. That doesn't mean it's reviewed, it means I'm accepting it to _BE_ what I go with and ultimately review.
- solumunus 1y ago> getting a 30x to 50x productivity gain That is an absurd claim.
- tcoff91 1y agoIf you get a 30x gain then you're a 0.05x developer. a 50x gain would literally mean you could get a year's worth of work done in a week. Preposterous.
- fkyoureadthedoc 1y agoBad/dumb developers don't get much of a boost in my experience working with a plethora of shitty contractors. Good developers aren't getting a 30x boost I don't think, but they are getting more out of the tooling than bad developers. The bottleneck is still finding good developers, even with the current generation of AI tooling in play.
- quantadev 1y agoIt was when I started using Github Copilot in "Agent Mode" that my LLM productivity gains went from like 5x to 30x. People who are just using a chatbot get like 5x gains. People who use "Agent Mode" to write up a description of a new feature that would take several days by a human, but get it done in one click by an Agent, are getting 30x or more. The amount of pushback I got on this thread tells me most devs simply haven't started using actual Agents yet.
- tcoff91 1y agoI’ve tried using agents. LLMs just can’t reliably accomplish the tasks that I have to do. They just get shit wrong and hallucinate a ton. If I don’t break the task down into tiny chunks then they go off the rails.
- quantadev 1y agoThis can definitely happen, because the context windows even in a great Agent can become flooded. I often do prompts like "Add a row of buttons at the top right named 'copy', 'cut', and 'paste'", and let the Agent do that, before I implement each button, for example. The rule of thumb I've learned is to give an Agent the smallest possible task at a time, so there's zero ambiguity in the prompt, and context window is kept small.
- tcoff91 1y ago30x productivity gain? gtfo of here. Most things I try to use it for, it has so many problems with its output that at most I get a 50% productivity gain after fixing everything. I'm already super efficient at editing text with neovim so honestly for some tasks I end up with a productivity loss.
- quantadev 1y agoI can easily get a month of work done in a single day yes. So probably the 30x is about the current max, and 50x was hyperbole, because I didn't add it up before doing that post.
- prmph 1y agoI just don't believe this. It's weird; I just don't know where folks are getting these extreme productivity gains from. For example, the other day I asked a major LLMs to generate a simple markdown viewer with automatic section indentation for me in Node.js. The basic code worked after a few additional prompts from me. Now I wanted folding. That was also done by the LLM. And then when I tried to add a few additional simples features, things fell apart. There were one or two seemingly simple runtime errors that the LLM was unable to fix after almost 10 tries. I could fix it if I started digging inside the code, but then the productivity gains would start to slip away.
- quantadev 1y agoI'll spend like 10 minutes crafting a prompt that explains a new feature to be added to my app. I explain it in enough detail, with zero ambiguity, such that any human [senior] developer could do it. Often the result is 100s of lines of code generated, and well over 95% of the time the code "Claude 4" generates is exactly what I wanted. I'm using VSCode Github Copilot in "Agent Mode", btw. It's able to navigate around an entire project, understand it, and work on it. You just lean back and watch it open files, edit them, show you in realtime what it's thought process is, as it does everything, etc. etc. It's truly like magic. Any other way of doing development, in 2025, is like being in the stone ages.
- deleted 1y ago[deleted]
- codr7 1y ago30x-50x :) Right, if you're getting that, experienced senior is a pretty wild stretch.
- Workaccount2 1y ago>while entry level or junior devs basically only have one "Filter" by which they determine code quality which is: "Does the code seem to work?". Based on my general experience with software over the last...30 years, most places must only have entry level and junior devs. Somehow despite 30 years of hardware improvement, basic software apps are still as clunky and slow as their '90s counterparts.
- quantadev 1y agoThe only thing more reckless than a junior is an LLM-empowered junior.