3 ms·
But they could, if they needed to. But most people don’t need to, so they don’t keep that information in their brains. I can’t tell you the date of every time
by nkrisc 3y ago
But they could, if they needed to. But most people don’t need to, so they don’t keep that information in their brains.
I can’t tell you the date of every time I clip my toenails, but if I had to could remember it.
- cultureswitch 3y agoLLMs can remember their sources. It's just additional knowledge, there's nothing special about it. When you ask an LLM to tell you the height of Mount Everest, it clearly has a map of mountains to heights, in some format. Using exactly the same mapping structure, it can remember a source document for the height.
- nkrisc 3y agoNo, it “knows” that one of the tokens that commonly follows is “29,031 ft”.