Gato already achieved AGI with a transformer model months ago using a laughably low parameter count. Transformers and scaling are all you need. It's only a sho

Gato already achieved AGI with a transformer model months ago using a laughably low parameter count. Transformers and scaling are all you need. It's only a short matter of time before human and super human generalization are reached in ML models.