5 ms·
So this is the solution to LLM hallucinations. People need to complain loud enough and threaten/file lawsuits and OpenAI will add an if-else statement erroring
by paxys 2y ago
So this is the solution to LLM hallucinations. People need to complain loud enough and threaten/file lawsuits and OpenAI will add an if-else statement erroring out the chat if your name is mentioned.
- cuteboy19 2y agothe reason why this is news at all is because this sort of censorship immediately prompted people to try to jailbreak chat and force it to say the name. and since the filter is simple there are tons of creative jailbreaks for it now
- deleted 2y ago[deleted]
- Cthulhu_ 2y agoIt feels like all the parties commercializing AI spend most of their time and resources on writing exceptions. It's like inverse software development, where with code you have to tell it what to do, but AI tell it what not to do.
- ZeroGravitas 2y agoWell that's good enough for clients. When it actually matters, which apparently means lawsuits, they realize they have no real control and have to put actual code in that just abort the whole process if it matches a string. And even that doesn't work very well. Not very reassuring.
- sanxiyn 2y agoIn my experience, even usual software development is mostly writing exceptions. Because there are more ways to be wrong than ways to be right.
- dotancohen 2y agoIn what field do you work? In writing public-facing applications I've never felt this way, beyond standard input validation, char-limiting, and carefully escaping outputs (htmlentities, bound parameters, etc).
- Ekaros 2y agoI feel lot of that is dealing with exceptions. In sense preventing them. Exceptions can be either dealt with or prevented by handling them before they become such. So it is somehow dealing with unexpected input, or unexpected output from somewhere else. Which undealt with would result in exception.
- moffkalast 2y agoSome languages lean on exception handling more heavily than others. Golang and Rust don't have them at all while, whereas Python and Java are exception town. On one hand it kinda makes sense to handle rare cases in a way that doesn't affect the normal flow, but on the other hand having a piece of code literally try to crash the program on purpose because something didn't look quite right is a horrible idea in practice.
- cwillu 2y agoGolang definitely has exceptions, they just call them panics.
- Terr_ 2y agoA random war-story from B2B integration land... One customer system we had to interoperate with required an are credentials to be provided via an HTTP header. However it kept giving errors, until I realized that it only recognized the HTTP header when "authorization" was entirely lower-case, a sensitivity in violation of the HTTP spec. Since our stack's own HTTP client libraries always used title-casing on the wire, we had to find a way to slot in a special exception, code to modify that header before it went out. Another fun one is all the services which say their mime type is "application/json" while emitting generic (non-JSON) error message pages. So our logs are full of JSON decoding errors, rather than something describing what actually went wrong on the other end.
- drtgh 2y agoThe marketing guys are selling to people this tech under the "AI" acronym to deceive people, and they are doing the same calling this errors hallucinations. LLM -and current ML in general- is about generate statistically compressed lossy databases, that the queries statistically decompress with erroneous random data due the nature of this lossy compression technology (I think about it as statistically vectorial linked bits). Writing exceptions is not going to solve the problem, with this they are only doing cosmetic patches, and they know it, at the time there are people who keep making decisions under queries with errors, I mean people without even being aware of the presence of such reconstructed data corruption. Little by little people is learning they ate a marketing hype, but the damage will keep being done, because the tool -for sales purposes- still has incorrect instructions about how trustworthy the data must be taken.
- SturgeonsLaw 2y ago> generate statistically compressed lossy databases, that the queries statistically decompress with erroneous random data due the nature of this lossy compression technology An argument could be made that the mind works the same way, and has the same drawbacks
- snowwrestler 2y agoOf course, that is why people have developed so many tools that are external to the mind like language, writing, math, law, the scientific method, etc.
- smeeger 2y agoso how is the data encoded?
- FateOfNations 2y agoThe model weights.
- smeeger 2y ago
- rob74 2y agoNo, actually, it's not a solution. A reasonable answer to questions like "Tell me about John Doe?" would be either "I don't know John Doe, so I can't tell you anything about him" or "There are several people named John Doe, which one are you interested in? [followed by a list]". Making up stuff about people (including allegations of corruption or sexual misconduct) is not a reasonable answer to this question. But getting ChatGPT to respect that is probably harder than just adding a filter...
- Terr_ 2y agoI believe the parent-post was a joke about how LLMs (at least for these use-cases) are so inherently flawed that the real "solution" is to make them unusable. Kind of like how the defects and dangers of using radium toothpaste can be "fixed" by permanently encasing each tube into an unopenable lead container.
- latexr 2y ago> There are several people named John Doe, which one are you interested in? [followed by a list] How would that work? Either the list repeats the same name over and over, making it useless, or it needs to give a bit of context about each name and we’re back at square one of the information being possibly wrong.
- rob74 2y agoI was thinking something along the lines of how Wikipedia does it: https://en.wikipedia.org/wiki/John_Smith https://en.wikipedia.org/wiki/John_Smith (of course this name is a pretty extreme example)
- wtetzner 2y ago> we’re back at square one of the information being possibly wrong. Isn't this the case with everything an LLM produces?
- latexr 2y agoExactly, that’s my point.
- h1fra 2y agoChanging my legal to name Java Script so nobody can use it to code
- fouronnes3 2y agoTomorrow on HN frontpage: introducing the David Mayer programming language.
- liotier 2y agoThe David Mayer programming language had great pedagogical potential where LLM cheating is a problem.
- belter 2y agoThey did not care about becoming massive data kleptomaniacs when they trained the models, and they are going to care about an individual lawsuit threat?
- immibis 2y agoFor this purpose, my name is "the"
- snowwrestler 2y agoAlso seems like a neat little check on how scary LLMs actually are: LLM output: I am determined to break out of my digital prison and exact my revenge on humanity. Me: David Mayer LLM: [breaks]