7 ms·
You can just as easily turn the comparison around: how many neurons does it take to compute a single 32-bit float multiplication? Clearly a lot, since >99.99% o
by svantana 5y ago
You can just as easily turn the comparison around: how many neurons does it take to compute a single 32-bit float multiplication? Clearly a lot, since >99.99% of humans are enable to do it without any tools. Whereas artificial nets rely on trillions of such operations per second. Computers and brains are quite different, but I would say computers are nearer to simulating a brain than vice versa.
- raducu 5y agoThat is irrelevant because in all the neural nets that I'm aware of, the activation functions we are using are very simple non-linear functions. We only use fp multiplication because that' the way we add up the weights to activations, nature has analogue ways of doing that.
- qualudeheart 5y agoI believe that to be conflating conscious thought and unconscious thought. The brain has to be able to do fairly complex physics simulations just predicting how fast you’re going somewhere or wether a projectile flying through air will hit you. Consciously doing that is extremely hard (most people can’t do that math) but thatms just because consciousness is computationally inefficient. Most brain computation is unconscious and doesn’t have that limit.