3 ms·
Nope. I don't think anyone thinks the brain is an N layer deep network. There are many networks, and they cross-couple inputs and outputs from various subnetwor
by tasty_freeze 5y ago
Nope. I don't think anyone thinks the brain is an N layer deep network. There are many networks, and they cross-couple inputs and outputs from various subnetworks into others. There are also hormonal regulatory systems with feedback mechanisms that interact with these networks both is inputs and outputs. The brain is hugely more complicated and messy than anything that, say, GPT-3 is doing.
- 9wzYQbTYsAIc 5y agoSo Parallel Distributed Processing, it is? Apparently deep learning has been beat-to-death as a word, but the way deep learning was explained to me, it is an approach not a specification.
- kortilla 5y agoYeah, if you dilute the meaning down to “feedback loop”, then deep learning and the brain work the same way.
- 9wzYQbTYsAIc 5y agoI’m not sure that it is correct to limit deep learning to just a feedback loop, but cybernetics (if the thermostat variety, not the terminator variety) might be the right word.
- hajile 5y agoI'd also add that the subconscious parts of the brain seem to function quite a bit differently from the conscious parts. It's hard to reason about something like "why does my eye see how it does" when those parts aren't consciously accessible.