A mixture of many architectures. LLMs will probably play a part. As for other possible technologies, I'm most excited about clone-structured causal graphs[1].

A mixture of many architectures. LLMs will probably play a part. As for other possible technologies, I'm most excited about clone-structured causal graphs[1]. What's very special about them is that they are apparently a 1:1 algorithmic match to what happens in the hippocampus during learning[2], to my knowledge this is the first time an actual end-to-end algorithm has been replicated from the brain in fields other than vision. [1] "Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps" https://www.nature.com/articles/s41467-021-22559-5 https://www.nature.com/articles/s41467-021-22559-5 [2] "Learning produces an orthogonalized state machine in the hippocampus" https://www.nature.com/articles/s41586-024-08548-w https://www.nature.com/articles/s41586-024-08548-w