3 ms·
> What's this guy is describing is pretty much the root cause of what we colloquially refer to as "hallucination". I thought a hallucination is when it provide
by lcnPylGDnU4H9OF 2y ago
> What's this guy is describing is pretty much the root cause of what we colloquially refer to as "hallucination".
I thought a hallucination is when it provides fabricated facts because it is more interested in generating another token than being factually accurate? Not trying to argue, just trying to pin down a definition for this term.
- wccrawford 2y agoYeah. An MLM basically just computes the mostly likely thing based on its training, and says that. If it has no knowledge of a thing, it still calculates the most likely thing, which is a hallucination since it can't possible calculate that effectively. Regurgitating false statements is not a hallucination, it's bad training data. It's the difference between being wrong and just making things up from nothing.