4 ms·

> That's the argument kings used to justify looking down on peasants. Peasants do become kings though, but we still need a human prompter for these AI models i

> That's the argument kings used to justify looking down on peasants. Peasants do become kings though, but we still need a human prompter for these AI models instead of just connecting them to a bug tracker. > AI, as it is currently, has no motivation of its own; it is just as "happy" to solve a business problem as it is to write Chinese poetry about Swiss software engineers taking their dogs on a ride up the Adliswil-Felsenegg cable car. You don't need any more motivation than any other worker, you do the tasks assigned to you but currently you need a prompter middleman. > Good communication skills are still important to get what you want, otherwise we merely descent into a particular SMBC comic: https://www.smbc-comics.com/index.php?id=3576 https://www.smbc-comics.com/index.php?id=3576 But currently you communicate that with a human that then translates your needs to an LLM, why do we still need that middleman? There are so many well described problems and projects out there already, why can't you connect an LLM to them and make it complete those projects on its own?

ben_w 2y ago
> Peasants do become kings though, but we still need a human prompter for these AI models instead of just connecting them to a bug tracker. What I said is sufficient to show why the parent comment wasn't necessarily agreeing "they aren't reasoning". Likewise: > You don't need any more motivation than any other worker, you do the tasks assigned to you but currently you need a prompter middleman. In response to "Otherwise why would you need a human to do skillful prompting": The tasks being assigned to me are prompts. They're prompts written in the form of a JIRA ticket, but they're prompts. If you point me at a codebase and say "make it better", I'll get right on that vague statement: add unit tests, refactor stuff, make sure there's suitable levels of abstraction… but since when are those business goals? Point me at a codebase and not give me any direction at all? I'll use the app (or whatever) for a bit, see what feels like a bug, try to fix that, then twiddle my thumbs. > But currently you communicate that with a human that then translates your needs to an LLM, why do we still need that middleman? As I'm a software developer, I think I'd be the middle-man here, surely? > There are so many well described problems and projects out there already, why can't you connect an LLM to them and make it complete those projects on its own? Quality. The better ones I've tried (most recently o1) seem to be slightly better than a recent graduate, but not senior level. The code works, but only most of the time, and like a junior it will need help.

ben_w 2y ago

> Peasants do become kings though, but we still need a human prompter for these AI models instead of just connecting them to a bug tracker. What I said is sufficient to show why the parent comment wasn't necessarily agreeing "they aren't reasoning". Likewise: > You don't need any more motivation than any other worker, you do the tasks assigned to you but currently you need a prompter middleman. In response to "Otherwise why would you need a human to do skillful prompting": The tasks being assigned to me are prompts. They're prompts written in the form of a JIRA ticket, but they're prompts. If you point me at a codebase and say "make it better", I'll get right on that vague statement: add unit tests, refactor stuff, make sure there's suitable levels of abstraction… but since when are those business goals? Point me at a codebase and not give me any direction at all? I'll use the app (or whatever) for a bit, see what feels like a bug, try to fix that, then twiddle my thumbs. > But currently you communicate that with a human that then translates your needs to an LLM, why do we still need that middleman? As I'm a software developer, I think I'd be the middle-man here, surely? > There are so many well described problems and projects out there already, why can't you connect an LLM to them and make it complete those projects on its own? Quality. The better ones I've tried (most recently o1) seem to be slightly better than a recent graduate, but not senior level. The code works, but only most of the time, and like a junior it will need help.