3 ms·
>> So I don't think that the human capacity for learning supports the idea that a tabula rasa AI system should be able to learn any particular thing with just a
by YeGoblynQueenne 7y ago
>> So I don't think that the human capacity for learning supports the idea that a tabula rasa AI system should be able to learn any particular thing with just a handful of examples.
I don't know if Brooks is talking about learning everything from scratch here.
I for one don't think that humans come into the world as tabulae rasae. I
think instead that we come endowed with a rich knowledge of the world already,
as well as strong inductive biases that allow us to learn new concepts from a
combination of existing knowledge and new observations, with our
characteristically high sample efficiency that remains unmatched by neural
nets.
For instance, one theory about our ability to learn human language as infants
is that we are born with a language endowment, Chomsky's "universal grammar",
that predisposes us to pick out and learn human language, without having to
figure it out from scratch.
I wonder then if what Brooks is saying is missing from neural nets is the
ability to use background knowledge and strong inductive biases as effectively
and efficiently as we do, so that they don't need hundreds of thousands of
examples before they can learn a new concept.