2 ms·
>> That's because we don't need to represent any function; we need to represent the class of functions that can be efficiently represented in a human brain as w
by YeGoblynQueenne 10y ago
>> That's because we don't need to represent any function; we need to represent
the class of functions that can be efficiently represented in a human brain as
well, which is pretty much the same.
The problem is that to learn a function from examples you need the right kind of
examples, and for human cognitive faculties it's very hard to get that.
For instance, take text- text is a staple in machine-learning models of
language... but it is not language. It's a bunch of symbols that are only
intelligible in the context of an already existing language faculty. In other
words, text means nothing unless you already understand language, which is why
although we can learn pretty good models of text, we haven't made much progress
in learning models of language. Computers can generate or recognise language
pretty damn well- but when it comes to understanding it... Well, we haven't even
convincingly defined that task, let alone being able to train anything, RNN or
whatever, to perform it.
You can see similar issues with speech or image processing, where btw RNNs have
performed much better than with language.
So, just because RNNs can learn functions in principle it doesn't mean that we
can really reproduce human behaviour in practice.