There is definitely evidence that self-supervised predictions using e.g. Transformers is helpful for AGI. The brain has 100k cortical columns that to the best o

There is definitely evidence that self-supervised predictions using e.g. Transformers is helpful for AGI. The brain has 100k cortical columns that to the best of our knowledge predict the next state given the current one. We've seen how these models can be used on all modalities, text, audio, images and video. It's a small part of what's necessary but to say there's "no evidence" is complete hyperbole.