5 ms·
As AI advances, there will be AI and algorithms that will check LLMs and their output, sort of LLMs' verifier. It is foolish to think that LLMs won't improve to
by mrkramer 3y ago
As AI advances, there will be AI and algorithms that will check LLMs and their output, sort of LLMs' verifier. It is foolish to think that LLMs won't improve to the point where there are almost no or very low hallucinations and false information. We are just at the beginning of LLMs and generative AI.
- hermitcrab 3y agoHow do you automatically verify that an LLM isn't hallucinating?
- mrkramer 3y agoIdk, ask LLMs researchers....they will figure it out sooner or later.
- hermitcrab 3y agoYour faith is touching.
- Jensson 3y agoWhen people don't know how to do something but think it is easy, then it can often take 50 years or more for that to happen. Has happened before in this field.
- vrighter 3y ago"The queen is ________" The model predicts a 99% chance that the next word is "alive" and a 1% chance that it's "dead". The llm calculates probabilities. How does it actually choose the word? It throws a weighted die. It literally chooses one at random (albeit on a custom probability distribution). So tell me, what how can you eliminate hallucinations from something that is literally designed to pick stuff at random? Hallucinations will never be removed from these types of llms. Hallucinations are fundamental to how they work. In the sense that even the "good" outputs are hallucinations picked out at random from a probability distribution. Any company that says they can control hallucinations, in any way, is flat out lying.
- tim333 3y agoYou go back and check like we humans do.
- vrighter 3y agocheck what, exactly? The model already did the best it could. It can't check its own work. And if I have to find out the answer myself from some other source in order to confirm the answer then that makes the model useless.
- tim333 3y agoI just tried GPT4 with "is the queen alive?" and it came back with 'hold on, checking Bing' followed by "Queen Elizabeth II passed away..." That kind of thing.