4 ms·
> I really don't understand why anyone expects LLM citations to be correct It can be done if you do something like: 1. Take user’s prompt, ask LLM to convert
by cj 2y ago
> I really don't understand why anyone expects LLM citations to be correct
It can be done if you do something like:
1. Take user’s prompt, ask LLM to convert the prompt into a elastic search query (for example)
2. Use elastic search (or similar) to find sources that contain the keywords
3. Ask LLM to limit its response to information on that page
4. Insert the citations based on step 2 which you know are real sources
Or at least that’s my naive way of how I would design it.
The key is limiting the LLM’s knowledge to information in the source. Then the only real concern is hallucination and the value of the information surfaced by Elastic Search
I realize this approach also ignores benefits (maybe?) of allowing it full reign on the entire corpus of information, though.
- Groxx 2y agoIt also doesn't prevent it from hallucinating something wholesale from the rest of the corpus it was trained on. Sometimes this is a huge source of incorrect results due to almost-but-not-quite matching public data. But yes, a complete list of "we fed it this" is useful and relatively trustworthy in ways that "ask the LLM to cite what it used" is absolutely not.
- mkehrt 2y agoWhy would you expect step 3 to work?
- __loam 2y agoThat's the neat part, it doesn't