Nobody can predict the future, but what is currently researched: - coupling deep learning with some kind of memory - non generative hierarchical architecture (

Nobody can predict the future, but what is currently researched: - coupling deep learning with some kind of memory - non generative hierarchical architecture (see LeCun JEPA) - mixing deep learning with symbolic methods (usually search over token or latent space, it can also be a coupling with symbolic engines. Coupling LLMs with wolfram was a very early example) - ability to perform unbounded computation per token inside a deep network. Something like Universal Transformers