4 ms·
There was an article a few years ago called "Lost in the Middle: How Language Models Use Long Contexts" https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2
by supermatt 2mo ago
There was an article a few years ago called "Lost in the Middle: How Language Models Use Long Contexts" https://arxiv.org/abs/2307.03172 https://arxiv.org/abs/2307.03172
From my experience this holds true to this day. It was one of my core observations for similarity to the limitations of human working memory on "Engineering for Bounded Cognition"
- JSR_FDED 2mo agoRichard Hendricks solved this decisively with middle-out compression
- supermatt 2mo agoI didn't get the reference, but it looks like im going to have to watch that series now :D
- JSR_FDED 2mo agoIt holds up really well. I’m envious you get to watch it for the first tome, enjoy!
- 83642736392 2mo ago[dead]