5 ms·
Gato is a model of models, if you read the paper they trained it on multiple datasets, and is actually what I was referring to in my comment.
by joshcryer 4y ago
Gato is a model of models, if you read the paper they trained it on multiple datasets, and is actually what I was referring to in my comment.
- PeterisP 4y agoGato is not a model of models - of course they trained it on multiple datasets, but the result is a single model that shares weights across the tasks (the key difference between single model and model-of-models architectures) so it is able to transfer knowledge from one dataset to the other datasets and also generalizes to unseen tasks on which Gato was not trained at all.