I think an attention/focus system might be applicable. I think humans have the same limitations, with tricks to work around it. As Jim Keller once said on an Le

I think an attention/focus system might be applicable. I think humans have the same limitations, with tricks to work around it. As Jim Keller once said on an Lex Fridman interview, a good engineer is one that can jump around between the different levels of abstraction. We think in a high level, then "focus" and jump down when needed. I think something like this could be hacked together, with summarization and parallel "focus threads", containing prompts that focus on details. These could be pruned/merged back together, to add to the "summary" higher level abstractions. I use this approach already, to some extent, when a conversation gets too long and I need specific details. I'll start a new prompt, include a high level summary, and then "focus" on specific ideas to get more specific answers about a particular detail.