3 ms·
Much like you can search the internet until you find a source that agrees with you, you can select a set of papers that "confirm" a particular viewpoint, especi
by Retr0id 2y ago
Much like you can search the internet until you find a source that agrees with you, you can select a set of papers that "confirm" a particular viewpoint, especially in developing fields of research. In this case, the selected papers all support the view LLMs "know what they know" on some internal level, which iiuc is not (yet?) a consensus viewpoint (from my outsider perspective). But from the list alone, you might get that impression.
Related:
Still no lie detector for language models: probing empirical and conceptual roadblocks - https://link.springer.com/article/10.1007/s11098-023-02094-3 https://link.springer.com/article/10.1007/s11098-023-02094-3
Hallucination is Inevitable: An Innate Limitation of Large Language Models - https://arxiv.org/abs/2401.11817 https://arxiv.org/abs/2401.11817
LLMs Will Always Hallucinate, and We Need to Live With This - https://arxiv.org/abs/2409.05746 https://arxiv.org/abs/2409.05746
(disclaimer, I also have not read any of these papers beyond the title!)