2 ms·
One way to improve this issue is to focus on retrieval-augmented models, i.e. models that include an explicit retrieval step from a corpus of documents and try
by amilios 3y ago
One way to improve this issue is to focus on retrieval-augmented models, i.e. models that include an explicit retrieval step from a corpus of documents and try to "cite" their sources as they produce text. However then oftentimes you get a more advanced form of the hallucination problem, where the model writes a piece of text, cites a document, but the document actually has nothing to do with what was written. It's a tricky problem for sure