2 ms·
Some things like: https://arxiv.org/abs/2310.18168 https://arxiv.org/abs/2310.18168 https://arxiv.org/abs/2310.06824 https://arxiv.org/abs/2310.06824 There a
by astrange 2y ago
Some things like:
https://arxiv.org/abs/2310.18168 https://arxiv.org/abs/2310.18168
https://arxiv.org/abs/2310.06824 https://arxiv.org/abs/2310.06824
There are various reasons an LLM might have incorrect "beliefs" - the input text was false, training doesn't try to preserve true beliefs, quantization certainly doesn't. So it can't be perfectly addressed, but some things leading to it seem like they can be found.
> https://arxiv.org/abs/2401.11817 https://arxiv.org/abs/2401.11817
This seems like it's true since LLMs are a finite size, but in Google's case it has a "truth oracle" (the websites it's quoting)… the problem is it's a bad oracle.