have people not seen the videos of Gato? it's pretty mind blowing. it's ability is beyond belief, and it's not even the scaled up version, since there have been

have people not seen the videos of Gato? it's pretty mind blowing. it's ability is beyond belief, and it's not even the scaled up version, since there have been clear demonstrations that scaling improves model performance. to me, Gato is pure proof that tranformers are waaaaaay more capable of emergent understanding than people seem to be willing to admit. https://www.deepmind.com/publications/a-generalist-agent https://www.deepmind.com/publications/a-generalist-agent https://www.deepmind.com/blog/building-interactive-agents-in-video-game-worlds https://www.deepmind.com/blog/building-interactive-agents-in...