I suppose that's one read of themafia's comment. My read of it was "this is why humans are fundamentally different from LLMs", not "this is how you fix LLMs to

I suppose that's one read of themafia's comment. My read of it was "this is why humans are fundamentally different from LLMs", not "this is how you fix LLMs to be like humans". It's still hard to see how you can argue that humans' "context window", looked at in even a vaguely similar manner to that of LLMs, is tiny.