3 ms·
> If my boss/partner/whoever gives me some mandates/orders (basically), I don't just forget about them because they were at the beginning of the conversation.
by scotty79 1mo ago
> If my boss/partner/whoever gives me some mandates/orders (basically), I don't just forget about them because they were at the beginning of the conversation.
Your context window is 80 years. You are forgetting plenty before you reach the end of it.
- 10xDev 1mo agoYou generally forget things you don't retrieve. It is not really a bug but a way to declutter for efficiency. That's not the same as it not fitting your context window because it was at the beginning.
- scotty79 1mo agoIt's not about not fitting in context window. LLMs also can "forget" the things from their early context window that they do not restate later. It's also a form of decluttering. You can't (and shouldn't) remember (pay attention to) old stuff with the same priority as new, more relevant stuff.
- bcrosby95 1mo agoYeah, I already don't remember what I had for breakfast two days ago.
- oblio 1mo agoI forget that, too. But if my partner tells me they're allergic to shellfish, I'm not going to order oysters for them tonight. See the difference?