3 ms·
Backprop requires global communication but biological brain works with local communication in neural assemblies, where signals spread in a way somewhat similar
by andyxor 6y ago
Backprop requires global communication but biological brain works with local communication in neural assemblies, where signals spread in a way somewhat similar to diffusion.
There is no global “teaching signal” or “delta rule” error correction. Learning via reward and punishment is a wrong level of abstraction for fundamental cognitive tasks like visual object recognition or “parsing” auditory signal.
Sometime people mention dopamine as a kind of reinforcement signal but it operates on completely different time scale, orders of magnitude slower than any iterative optimization model would require.
And the energy and time spent on iterative optimization in ANNs is not available to living organisms with constrained resources.
If you’re interested in authoritative opinion on what kind of learning is biologically plausible see e.g. prof. Edmund Rolls recent book called “Brain Computations”.