4 ms·
Sounds like Google's AI produced some stats that were quite obviously mistaken, but nobody cared to fact-check in the slightest before shipping. > the Google e
by WhyNotHugo 2y ago
Sounds like Google's AI produced some stats that were quite obviously mistaken, but nobody cared to fact-check in the slightest before shipping.
> the Google executive Jerry Dischler said this was not a “hallucination” [...] but rather a reflection of the fact the untrue information is contained in the websites that Gemini scrapes.
What's this guy is describing is pretty much the root cause of what we colloquially refer to as "hallucination".
- lcnPylGDnU4H9OF 2y ago> What's this guy is describing is pretty much the root cause of what we colloquially refer to as "hallucination". I thought a hallucination is when it provides fabricated facts because it is more interested in generating another token than being factually accurate? Not trying to argue, just trying to pin down a definition for this term.
- wccrawford 2y agoYeah. An MLM basically just computes the mostly likely thing based on its training, and says that. If it has no knowledge of a thing, it still calculates the most likely thing, which is a hallucination since it can't possible calculate that effectively. Regurgitating false statements is not a hallucination, it's bad training data. It's the difference between being wrong and just making things up from nothing.