7 ms·
On some level this makes sense, but on the other hand LLMs already have perfect recall of thousands of symbols built into them, which is what pencil and paper g
by Dylan16807 1y ago
On some level this makes sense, but on the other hand LLMs already have perfect recall of thousands of symbols built into them, which is what pencil and paper gives to a human test taker.
- zamadatix 1y agoIf only context recall was actually perfect! The data is certainly stored well, accurately accessing the right part... maybe worse than a human :D.
- Dylan16807 1y agoIf you're not doing clever hacks for very long windows, I thought a basic design fed in the entire window and it's up to the weights to use it properly.