3 ms·
> fundamentally ridden with "hallucinations" that will severely limit their practical usage On the other hand, a LLM that got rid of "hallucinations" is basica
by diggan 2y ago
> fundamentally ridden with "hallucinations" that will severely limit their practical usage
On the other hand, a LLM that got rid of "hallucinations" is basically just a thing that copy-paste at that point. The interesting properties from LLMs comes from the fact that it can kind of make things up but still make them believable.
- jampekka 2y agoAs per this article, even copy-paste hallucinate e.g. because there are no infinite datasets.
- SoftTalker 2y ago> can kind of make things up but still make them believable This is the definition of a bullshitter, by the way.
- Kerb_ 2y agoOr, you know, fiction writer. Some of us like little stories.
- _heimdall 2y agoIts important that anyone reading fiction knows its fiction. Without that we can run into a situation where a fictional story on the radio convinces the public that we are under alien attack in what could be called a war of the worlds.
- Kerb_ 2y agoYes! Or a situation where the public was not under any misconception at all, where there were multiple intermissions throughout the play calling attention to the fact that it was a work of fiction, but someone made up the idea of mass panic because it made for a good story that sold a lot of newspapers! I would say that it's the responsibility of the reader to read any content in the context of which it's published. For example, to expect a radio play to be fictional as the vast majority of listeners did.
- Too 2y agoTraining with inappropriate data will make copy-paste equally bad with hallucinating. For example, fiction or sarcasm may be taken out of context and used as a serious output. What's missing is sanity-checking the sources and the output.