4 ms·

It's not some innocent mistake. The title is purposefully clickbait / keyword-y, implying that it was chatgpt that made the 'mistake' for SEO and to generate pa

It's not some innocent mistake. The title is purposefully clickbait / keyword-y, implying that it was chatgpt that made the 'mistake' for SEO and to generate panicked clicks. "We made a programming error in our use of an LLM, didn't do any QA, and it cost us $10k" doesn't generate the C-suite "oh shit what if ChatGPT fucks up, what's our exposure!?" reaction. There's a million middle and upper management posting this article on LinkedIn, guaranteed. It's like the Mr. Beast open-mouth-surprised expression thumbnail nonsense; you feel incredibly compelled to click it. While we're on the subject: LLMs can't make "mistakes." They are not deterministic. They cannot reason, think, or do logic. They are very fancy word salad generators that use a lot of statistical probabilities. By definition they're not capable of "mistakes" because nothing they generate is remotely guaranteed to be correct or accurate. Edit: The mods boosted the post; it got downvoted into oblivion, for obvious reasons, and then skyrocketed instantly in rank, which means they boosted it: https://hnrankings.info/40627558/ https://hnrankings.info/40627558/ Hilarious that a post which is insanely clickbait (which the rules say should result in a title rewrite) got boosted by the mods. I'm sure it's a complete coincidence that the story was apparently authored by someone at a Ycombinator company: https://news.ycombinator.com/item?id=40629998 https://news.ycombinator.com/item?id=40629998

vsuperpower2020 2y ago
>By definition they're not capable of "mistakes" because nothing they generate is remotely guaranteed to be correct or accurate. This makes no sense. Only things that are guaranteed to be correct or accurate can make mistakes? Everyone knows what "mistake" means in this context. Nobody cares what your preferred definition of mistake is.
- southernplaces7 2y ago
  A good analogy would be nature: Is it making a mistake when something created by it fails in some way? Not really, since there's no conscious intent behind it and thus no correct or incorrect reasoning or a guarantee of either. LLMs share that trait.
- moritzwarhier 2y ago
  A mistake is usually seen as something that happens when someone (or metaphorically also, something) makes an error, but is capable of solving similar problems through understanding. Hard to put in words. But that's roughly what is concerning about the "AI makes mistakes" narratives. It implies they are caused by a (fixable) fault in reasoning or memory. LLM "AI" will always respond that it made a "mistake" when you correct it. It is trained to do so, and humans often behave similarly. It is hard to come up with a good definition for "mistake", yes. That does not change that using this in case of LLM hallucinations is misleading.
brabel 2y ago
> By definition they're not capable of "mistakes" because nothing they generate is remotely guaranteed to be correct or accurate. By that logic, nothing is capable of making mistakes :D. > Hilarious that a post which is insanely clickbait (which the rules say should result in a title rewrite) got boosted by the mods. You have a distorted view of what clickbait is and the rules of this site. I suggest you go calm down and try to stop hating on a technology which is just that: a technology! Like any other, it can be misused, but think about why exactly you feel so passionate about this particular technology.
- multjoy 2y ago
  Why do you feel bound to defend this particular technology? It is, after all, incapable of feeling hurt.
cbozeman 2y ago
The only part of your post that I do not agree with is: > It's like the Mr. Beast open-mouth-surprised expression thumbnail nonsense; you feel incredibly compelled to click it. I feel incredibly compelled to ignore it.
Akronymus 2y ago
> It's like the Mr. Beast open-mouth-surprised expression thumbnail nonsense; you feel incredibly compelled to click it. Sponsorblock is great for combating that. (Altough, I conciously avoid channels that mostly do clickbait anyways)

vsuperpower2020 2y ago

>By definition they're not capable of "mistakes" because nothing they generate is remotely guaranteed to be correct or accurate. This makes no sense. Only things that are guaranteed to be correct or accurate can make mistakes? Everyone knows what "mistake" means in this context. Nobody cares what your preferred definition of mistake is.

southernplaces7 2y ago
A good analogy would be nature: Is it making a mistake when something created by it fails in some way? Not really, since there's no conscious intent behind it and thus no correct or incorrect reasoning or a guarantee of either. LLMs share that trait.
moritzwarhier 2y ago
A mistake is usually seen as something that happens when someone (or metaphorically also, something) makes an error, but is capable of solving similar problems through understanding. Hard to put in words. But that's roughly what is concerning about the "AI makes mistakes" narratives. It implies they are caused by a (fixable) fault in reasoning or memory. LLM "AI" will always respond that it made a "mistake" when you correct it. It is trained to do so, and humans often behave similarly. It is hard to come up with a good definition for "mistake", yes. That does not change that using this in case of LLM hallucinations is misleading.

brabel 2y ago

> By definition they're not capable of "mistakes" because nothing they generate is remotely guaranteed to be correct or accurate. By that logic, nothing is capable of making mistakes :D. > Hilarious that a post which is insanely clickbait (which the rules say should result in a title rewrite) got boosted by the mods. You have a distorted view of what clickbait is and the rules of this site. I suggest you go calm down and try to stop hating on a technology which is just that: a technology! Like any other, it can be misused, but think about why exactly you feel so passionate about this particular technology.

multjoy 2y ago
Why do you feel bound to defend this particular technology? It is, after all, incapable of feeling hurt.

cbozeman 2y ago

The only part of your post that I do not agree with is: > It's like the Mr. Beast open-mouth-surprised expression thumbnail nonsense; you feel incredibly compelled to click it. I feel incredibly compelled to ignore it.

Akronymus 2y ago

> It's like the Mr. Beast open-mouth-surprised expression thumbnail nonsense; you feel incredibly compelled to click it. Sponsorblock is great for combating that. (Altough, I conciously avoid channels that mostly do clickbait anyways)