3 ms·
> 128k context? Absolutely insane 128k context is great and all, but how effective are the middle 100,000 tokens? LLMs are known to struggle with remembering s
by Swizec 3y ago
> 128k context? Absolutely insane
128k context is great and all, but how effective are the middle 100,000 tokens? LLMs are known to struggle with remembering stuff that isn't at the start or end of the input. Known as the Lost Middle
https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2307.03172
- saliagato 3y agosama said they improved it
- Der_Einzige 3y agoWe can't just take his word for it. This needs experimental verification. It's likely not even close to solved.
- drcode 3y agopeople now have access and can do any verification they want
- gjm11 3y agoIn fairness, humans have much the same problem.