3 ms·
The question is whether those larger NNs are reaching an asymptotic limit that is way below known human capabilities. Currently, NNs can only be said to surpas
by yters 8y ago
The question is whether those larger NNs are reaching an asymptotic limit that is way below known human capabilities. Currently, NNs can only be said to surpass human ability within a very narrow definition. However, if we do an apples to apples comparison, humans are still vastly superior to any NN on any task in terms of computation operations, memory and energy usage. We also learn in a inherently different way, using principles that are widely applicable. NNs, on the other hand, "learn" more in the sense of memorizing answers to a test. There is no understanding that NNs achieve which can be generalized and applied widely.
- bArray 8y agoIt is of my opinion that one approach to tackle this could be to impose structure, such as "this NN is responsible for this part". That way we could speed up overall training and build more complex NN architectures. That said I think there is still a lot of research to be done, they are not perfect, but I think we are barking up the right tree.
- yters 8y agoWhy do you think we are barking up the right tree? The assumption that mind = NN seems wrong on many levels.