3 ms·
LLMs don't have a concept of sources for their statements. Ask them to give you some literature recommendations on something it has explained to you. You'll ge
by Certhas 3y ago
LLMs don't have a concept of sources for their statements.
Ask them to give you some literature recommendations on something it has explained to you. You'll get plenty of plausible sounding papers that don't exist.
Humans know to some extent why they know (read it in a text book, colleague mentioned it). LLMs don't seem to.
- card_zero 3y agoThey read it in a non-existent average interpolation of the books actual humans read similar things in.
- mike_hearn 3y agoAsk a human to provide accurate citations for any random thing they know and they won't be able to do a good job either. They'd probably have to search to find it, even if they know they got it from a document originally and have some clear memory of what it said.
- Jensson 3y agoYes, humans wont lie to you about it, they will research and come up with sources. Current LLM doesn't do that when asked for sources (unless they invoke a tool), they come back to you with hallucinated links that looks like links it was trained on.
- mike_hearn 3y agoUnfortunately it's not an uncommon experience when reading academic papers in some fields to find citations that, when checked, don't actually support the cited claim or sometimes don't even contain it. The papers will exist but beyond that they might as well be "hallucinations".
- Jensson 3y agoHumans can speak bullshit when they don't want to put in the effort, these LLMs always do it. That is the difference. We need to create the part that humans do when they do the deliberate work to properly create those sources etc, that kind of thinking isn't captured in the text so LLMs doesn't learn it.
- intended 3y agoThe fact that a human chooses not to do remember their citations, does not mean they lack the ability. This argument comes up many times “people don’t do this” - but that is a question of frequency, not whether or not people are capable.
- phh 3y agoLLMs are capable as well if you give them access to the internet though
- Jensson 3y agoThey just paste in the first link then or some other programmed heuristic, they aren't like a human that puts in effort to find something relevant. An LLM with internet access isn't smarter than just asking google search.
- Certhas 3y agoHumans did research and remembered sources before the Internet was a thing. But also, can you give an example where an LLM with access to the Internet can find a primary source? I don't think learning to refer to sources is something inherently impossible for LLMs, but it is very different to the kind of implicit knowledge they seem to excel at.
- nkrisc 3y agoBut they could, if they needed to. But most people don’t need to, so they don’t keep that information in their brains. I can’t tell you the date of every time I clip my toenails, but if I had to could remember it.
- cultureswitch 3y agoLLMs can remember their sources. It's just additional knowledge, there's nothing special about it. When you ask an LLM to tell you the height of Mount Everest, it clearly has a map of mountains to heights, in some format. Using exactly the same mapping structure, it can remember a source document for the height.
- nkrisc 3y agoNo, it “knows” that one of the tokens that commonly follows is “29,031 ft”.
- nottorp 3y agoLLMs don't have any concepts period.