3 ms·
Can you cite a source for this, or are you speculating? My understanding was the opposite -- that the activity of a confabulating LLM is indistinguishable from
by duskwuff 2y ago
Can you cite a source for this, or are you speculating?
My understanding was the opposite -- that the activity of a confabulating LLM is indistinguishable from one giving factually accurate responses.
https://arxiv.org/abs/2401.11817 https://arxiv.org/abs/2401.11817
- astrange 2y agoSome things like: https://arxiv.org/abs/2310.18168 https://arxiv.org/abs/2310.18168 https://arxiv.org/abs/2310.06824 https://arxiv.org/abs/2310.06824 There are various reasons an LLM might have incorrect "beliefs" - the input text was false, training doesn't try to preserve true beliefs, quantization certainly doesn't. So it can't be perfectly addressed, but some things leading to it seem like they can be found. > https://arxiv.org/abs/2401.11817 https://arxiv.org/abs/2401.11817 This seems like it's true since LLMs are a finite size, but in Google's case it has a "truth oracle" (the websites it's quoting)… the problem is it's a bad oracle.