Most of what generative models produce is shit so they have to produce a lot in hopes _some_ of it is OK-ish. It's also about responsiveness. LLMs produce juni

Most of what generative models produce is shit so they have to produce a lot in hopes _some_ of it is OK-ish. It's also about responsiveness. LLMs produce junior-level quality of code at a rate of hundreds of lines per minute. I need it to produce enough to spot where it's completely wrong as quickly as possible to I can change the prompt. It's like a edit-compile-run cycle which you also need to be fast or you lose attention. I was tempted to say it's another _step_ in the edit-compile-run but often the code is so bad I don't even bother compiling.