Completely agree here. And the fact of the matter is, long term memory is actively being worked on. You can already approximate reasonably with a Vector DB and

Completely agree here. And the fact of the matter is, long term memory is actively being worked on. You can already approximate reasonably with a Vector DB and embeddings, feeding the relevant results into the context. As is increasing the "working memory" (context size) in a more efficient manner: https://arxiv.org/abs/2305.16300 https://arxiv.org/abs/2305.16300 This isn't even getting into using things like Tree of Thought techniques to improve reasoning abilities and limit the search space for each portion of the problem to a reasonable size.