Gato is not a model of models - of course they trained it on multiple datasets, but the result is a single model that shares weights across the tasks (the key d

Gato is not a model of models - of course they trained it on multiple datasets, but the result is a single model that shares weights across the tasks (the key difference between single model and model-of-models architectures) so it is able to transfer knowledge from one dataset to the other datasets and also generalizes to unseen tasks on which Gato was not trained at all.