4 ms·
To paraphrase a comment from another thread: Artificial neural networks have basically nothing to do with actual biological neurons. First, neuroscientists do
by argonaut 11y ago
To paraphrase a comment from another thread:
Artificial neural networks have basically nothing to do with actual biological neurons. First, neuroscientists do not have even a decent understanding of biological neurons: you cannot say that neural networks mimic neurons when we don't understand biological neurons. Of the bajillion things we do know neurons do, neural networks do on the order of 1% of those things. On the flip side, neural networks do a ton of things that biological neurons do not (like backpropagation(!)* ).
* In fairness, Hinton hypothesizes the brain has a way of doing backprop, but what he talks about only barely resembles actual backprop.
- proc0 11y agoRight, no debate there. They're inspired by biological neurons. But it's still a step in the right direction. The facts are we have billions of neurons and there's some form of information processing going on. Perhaps we could continue the trend, and model NN to include other brain cell features like whatever the glyal cells do for example.
- mac01021 11y agoA link to anything Dr Hinton has written about the brain doing backprop would be appreciated, if you've got one.
- etiam 11y agoYou can have a look at the second half of this video https://www.youtube.com/watch?v=IcOMKXAw5VA https://www.youtube.com/watch?v=IcOMKXAw5VA for a recent account. He has been suggesting this for almost a decade, but I don't know that there is any article (yet).
- bglazer 11y agoI've heard people suggest a comparison between birds wings and planes. We don't understand everything about bird wings. They're incredibly complex and messy biological structures. However, we do know enough about the general principles of aerodynamics to build aircraft. Perhaps a similar dynamic is at work here. We don't understand brains, but perhaps neural networks are able to capture the same principles of information processing.
- panic 11y agoYes, plane wings are built on fundamental physical principles. We do not know the fundamental physical principles of intelligence. Building an NN and hoping its brain-like structure will start to think is like building a flapping machine and hoping its bird-like structure will start to fly.
- kanzure 11y ago> Building an NN and hoping its brain-like structure will start to think is like building a flapping machine and hoping its bird-like structure will start to fly. But... you're replying in a comment thread that has explicitly stated that "NNs" don't at all qualify as "brain-like".
- argonaut 11y agoWhich was my response to someone implying we should make them more brain-like. So the comment was quite relevant.
- 0xcde4c3db 11y agoEdsger Dijkstra famously made such a comparison [1]: "The Fathers of the field had been pretty confusing: John von Neumann speculated about computers and the human brain in analogies sufficiently wild to be worthy of a medieval thinker and Alan M. Turing thought about criteria to settle the question of whether Machines Can Think, a question of which we now know that it is about as relevant as the question of whether Submarines Can Swim." [1] E. W. Dijkstra, EWD898: The threats to computing science
- dharma1 11y agoIt would be great to be able to replicate neurons and neural signals exactly. Direct interfacing between artificial neural networks and biological ones would be very interesting
- dharma1 11y agohttp://www.theguardian.com/technology/2016/jan/20/us-military-cyborg-connecting-humans-computers http://www.theguardian.com/technology/2016/jan/20/us-militar...