4 ms·

Great message but I wonder if the people who do everything via LLM would even care to read such a message. And at what point is it hard/impossible to judge whe

Great message but I wonder if the people who do everything via LLM would even care to read such a message. And at what point is it hard/impossible to judge whether something is entirely LLM or not? I sometimes struggle a lot with this being OSS maintainer myself

doug_durham 7mo ago
"the people who do everything via LLM". That's a bit of a straw man characterization. I don't believe that there are many professional developers "do everything with an LLM'. I don't even know what that statement means.
- HumbleBot 7mo ago
  [dead]
- csh0 7mo ago
  There may not be many, but these people do exist. I watched someone ask Claude to replace all occurrences of a string instead of using a deterministic operation like “Find and Replace” available in the very same VSCode window they prompted Claude from.
- notatallshaw 7mo ago
  On a widely used open source project I maintain I've been seeing PRs in the last month that are a little off (look okayish but are trivial or trying to solve problems in weird ways), and then when I look at their account they started opening PRs within the last few weeks, and have opened hundreds of PRs spread over hundreds of repositories.
- zenolove 7mo ago
  They do exist; if "professional" means "hired" it has no bearing on quality, it is not in any shape equivalent to "judicious" nor "careful". If salary goes into "push features" that's gonna be the only incentive.
- chamomeal 7mo ago
  I know a few of them. Anything than can be done by an LLM, will done by an LLM. They practically worship Claude
- seattle_spring 7mo ago
  If you follow any of the programming subs on Reddit, especially the AI-oriented ones, there are a lot of people that at least claim to not code at all anymore-- 100% of their contributions are from prompts.
- dumpsterdiver 7mo ago
  Agreed. Imo, it is important to distinguish which parts of “everything” carry the weight of the concern. By doing that - we may be able to remove “LLM” from that equation entirely. The direct problem isn’t that people are using LLMs for everything - it’s that some people can’t be bothered to provide reasonable diligence. Phrasing that concern by blaming LLMs implies that these were perfectly diligent human workers before LLMs came along. Do we really believe that to be the case?
  - jmye 7mo ago
    Do you think they were submitting as many PRs, or do you think maybe the LLMs are enabling them to vastly over submit to these projects, meaning that in this case, LLMs are the actual, whole problem? I find it odd how people will refuse to think about context when defending their toys.
nohren 7mo ago
I wonder if checking for false statements or hallucinations is the first step to detect entirely LLM
CodenameTim 7mo ago
I appreciate the compliment. I'm not sure. I've got a few PRs that I've been putting off reviewing because they're either an Agent or someone copy-pasting the output without review. There's an investment I'm not ready to pay quite yet, but I suspect I'll include a link to this when I respond.

doug_durham 7mo ago

"the people who do everything via LLM". That's a bit of a straw man characterization. I don't believe that there are many professional developers "do everything with an LLM'. I don't even know what that statement means.

HumbleBot 7mo ago
[dead]
csh0 7mo ago
There may not be many, but these people do exist. I watched someone ask Claude to replace all occurrences of a string instead of using a deterministic operation like “Find and Replace” available in the very same VSCode window they prompted Claude from.
notatallshaw 7mo ago
On a widely used open source project I maintain I've been seeing PRs in the last month that are a little off (look okayish but are trivial or trying to solve problems in weird ways), and then when I look at their account they started opening PRs within the last few weeks, and have opened hundreds of PRs spread over hundreds of repositories.
zenolove 7mo ago
They do exist; if "professional" means "hired" it has no bearing on quality, it is not in any shape equivalent to "judicious" nor "careful". If salary goes into "push features" that's gonna be the only incentive.
chamomeal 7mo ago
I know a few of them. Anything than can be done by an LLM, will done by an LLM. They practically worship Claude
seattle_spring 7mo ago
If you follow any of the programming subs on Reddit, especially the AI-oriented ones, there are a lot of people that at least claim to not code at all anymore-- 100% of their contributions are from prompts.
dumpsterdiver 7mo ago
Agreed. Imo, it is important to distinguish which parts of “everything” carry the weight of the concern. By doing that - we may be able to remove “LLM” from that equation entirely. The direct problem isn’t that people are using LLMs for everything - it’s that some people can’t be bothered to provide reasonable diligence. Phrasing that concern by blaming LLMs implies that these were perfectly diligent human workers before LLMs came along. Do we really believe that to be the case?
- jmye 7mo ago
  Do you think they were submitting as many PRs, or do you think maybe the LLMs are enabling them to vastly over submit to these projects, meaning that in this case, LLMs are the actual, whole problem? I find it odd how people will refuse to think about context when defending their toys.

nohren 7mo ago

I wonder if checking for false statements or hallucinations is the first step to detect entirely LLM

CodenameTim 7mo ago

I appreciate the compliment. I'm not sure. I've got a few PRs that I've been putting off reviewing because they're either an Agent or someone copy-pasting the output without review. There's an investment I'm not ready to pay quite yet, but I suspect I'll include a link to this when I respond.