4 ms·
> Can anyone explain to me why it is not possible for LLMs to output the reference material together with the answer? It can't do so in a particularly more rel
by dragonwriter 2y ago
> Can anyone explain to me why it is not possible for LLMs to output the reference material together with the answer?
It can't do so in a particularly more reliable way (in a single pass) because every piece of input data potentially contributes to every response, and there is no deterministic way to "capture" which input work was meaningfully relevant to the output.
You can ask an LLM to cite sources, which it will usually obediently do, but they may be incorrect or even completely invented-for-the-response sources. If you have access to an archive of the source data, you could do something like a semantically-aware search to try to attribute the answer to a work or multiple works in the training set, and if your setup is using RAG you can have the response (possibly bypassing the LLM, so this can be 100% reliable) identify any works that were consulted during the RAG step. You can't, of course, guarantee that the response was particularly focused on the cited source, while usually with a well-setup RAG setup the response should be informed by the retrieved documents, its possible that key aspects of the response are attributable to the general training of the model (and thus some other source or sources in the model) and not based on (and potentially even contradict) the doc(s) pulled inthe course of RAG.
- Gigachad 2y agoKind of like asking an artist what the source for their painting is. The source is a lifetime of viewing and practicing art, it’s not clear which pieces contributed which details to the final result.
- venusenvy47 2y agoCoPilot lists reference links after responses, but I have no idea if it is directly related to the LLM data. They might just be Bing results to my question.