I suspect cost/efficiency is a driving factor. Existing layered NN designs seem quite local, with fewer long-range connections than brains have. I'd bet that up

I suspect cost/efficiency is a driving factor. Existing layered NN designs seem quite local, with fewer long-range connections than brains have. I'd bet that updating non-local weights increases memory requirements, slows down computation by orders of magnitude, or both.