5 ms·
I wonder if the progress in artificial neural network technology is going to be correlated to discoveries on real neural networks.
by tunnuz 8y ago
I wonder if the progress in artificial neural network technology is going to be correlated to discoveries on real neural networks.
- amelius 8y agoI'm still wondering about the natural equivalent of back-propagation.
- no_identd 8y agohttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC3673183/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3673183/ Citations here: https://scholar.google.com/scholar?cites=6395717759743355511 https://scholar.google.com/scholar?cites=6395717759743355511
- p1esk 8y agoI think the term "backpropagation" has a different meaning in neurobiology.
- zerostar07 8y agothose are backpropagating spikes, not errors
- SubiculumCode 8y agoIsn't that mostly a supervised learning technique? Maybe the larger question is whether learning in the brain is better described as unsupervised or supervised.
- mrep 8y agoI don't know how babies learn to initially use words but after that entails 99% supervised learning through school IMO nowadays. I would even argue that most new economic growth is the also the result of general supervised learning (aka, learning from others because the wealth of human knowledge is way more than anyone can learn in a million lifetimes and so the economic growth comes from continuously combining new ideas that combine other new ideas).
- im3w1l 8y agoBut we aren't beating kids when they get facts wrong and we aren't giving them candy when they are right. So studying how the reward signal is computed should be interesting.
- mrep 8y agoBeating kids and giving them candy is way on the extreme side of reinforcement. Having good grades be praised by teachers/parents and bad grades be associated with disappointment is already pretty good since humans are highly receptive to other people's emotions.
- im3w1l 8y agoYeah I agree! I'm just saying there's gotta be a lot of intricate machinery to make such subtle reinforcements work.
- SubiculumCode 8y agoReally we are being too static in the thinking about it. Supervised learning can essentially be done by one brain region supervising another that is being trained. It doesn't have to be outside the skull.