3 ms·
> The general AI agent will be composed of many such models. Not necessarily, there is good evidence that a single model can work for many tasks - for example,
by PeterisP 4y ago
> The general AI agent will be composed of many such models.
Not necessarily, there is good evidence that a single model can work for many tasks - for example, the recent Gato system https://www.deepmind.com/publications/a-generalist-agent https://www.deepmind.com/publications/a-generalist-agent is a good example. It's just that we usually don't do that because for most practical purposes we want an agent for a specific purpose, and for most research experiments we want a simpler experiment to isolate some factor, so we usually train single-task models and don't try to make general systems.
- joshcryer 4y agoGato is a model of models, if you read the paper they trained it on multiple datasets, and is actually what I was referring to in my comment.
- PeterisP 4y agoGato is not a model of models - of course they trained it on multiple datasets, but the result is a single model that shares weights across the tasks (the key difference between single model and model-of-models architectures) so it is able to transfer knowledge from one dataset to the other datasets and also generalizes to unseen tasks on which Gato was not trained at all.