2 ms·
I'm not sure, but I think it's trying to say that deep learning as it stands is modeled on one aspect of a model of the brain, by developing out the 3 aspects t
by tudorw 7y ago
I'm not sure, but I think it's trying to say that deep learning as it stands is modeled on one aspect of a model of the brain, by developing out the 3 aspects they identify and having them act in unison would be potentially a good thing, disclaimer, I am neither a neuroscientist nor deep learning expert!
- skohan 7y agoWhat I understood is that they're saying deep learning relies on understanding neural processing in 3 parts: objective functions (activation functions maybe?), learning rules (I guess like back-prop/gradient descent?) and architecture (I assume network structure)? So it sounds like they want to use this componentization of neural processing to try to understand biological neural networks better.
- etbebl 7y agoThe objective function is the entire function the network is training toward, i.e. in a classification task it's the correct mapping of images to labels. The idea here is that real brains also optimize their weights to compute certain useful objective functions.