>Contextual real-time weight modification is definitely one of the breakthroughs required for AGI. It's already been invented: https://arxiv.org/abs/2202.05780

>Contextual real-time weight modification is definitely one of the breakthroughs required for AGI. It's already been invented: https://arxiv.org/abs/2202.05780 https://arxiv.org/abs/2202.05780 . That design is just very inefficient to scale up / use as a transformer backbone.