6 ms·
Which is easier for you to remember: facts you’ve seen a hundred times in your lifetime, or facts you’ve seen once or twice? For an LLM, I’d expect it to be si
by Hackbraten 1y ago
Which is easier for you to remember: facts you’ve seen a hundred times in your lifetime, or facts you’ve seen once or twice?
For an LLM, I’d expect it to be similar. It can recall the stuff it’s seen thousands of times, but has a hard time recalling the niche/underdocumented stuff that it’s seen just a dozen times.
- gtsop 1y ago> Which is easier for you to remember: facts you’ve seen a hundred times in your lifetime, or facts you’ve seen once or twice? The human brain isn't a statistical aggregator. If you see a psychologically socking thing once in your lifetime, you might remember it even after dementia hits when you're old. On the other hand, you pass by hundrends of shops every day and receive the data signal of their signs over and over and over, yet you remember nothing. You remeber stuff you pay attention to (for whatever reason)