3 ms·
What's special about 2018 computing power? Neural networks have been declared dead several times in the past. Because they couldn't do anything interesting with
by Houshalter 8y ago
What's special about 2018 computing power? Neural networks have been declared dead several times in the past. Because they couldn't do anything interesting with the measly computing power available at the time. Currently the biggest RNNs have a few thousand neurons. Which is absolutely puny compared to even animal brains.
Of course this is defending a strawman. I don't know anyone that said it was just a computing power issue. In fact I think most people vastly underestimate the role of computing power. Even algorithmic improvements are enabled by computers letting researchers do experiments that would have been impossible before. And by doing lots of experiments they gain intuition about the problem, that they wouldn't develop in a vacuum.
- z3phyr 8y agoThe real fallacy is calling neural networks the analogue of animal brains. We still have a lot of research to accomplish in this sphere.
- candiodari 8y agoThey aren't. You're looking for "hebbian learning". Very different from neural networks. In 50 years people will laugh about how poorly these things were named. Just like we now laugh about what symbol we chose for a source of electrons in a circuit : "+". Whoops.