3 ms·
The brain is slow and redundant. It has to be like that because it is not produced in a factory - it is created by self replication. Self replication imposes st
by visarga 9y ago
The brain is slow and redundant. It has to be like that because it is not produced in a factory - it is created by self replication. Self replication imposes strict limits and requirements on the type of brain that can be created. AI neurons, on the other hand, are perfect - they never get old or tired and always remember. A neural net like ResNet-150 is capable of doing essentially what 1/3 of the brain is doing (vision). We can achieve superhuman results in vision with much less neurons, and faster. This is the kind of logic that makes brain emulation a far flung possibility compared to the current day deep neural nets.
That and the fact that the brain simulation guys don't have anything to show for. There are no human-level tasks that could be replicated by this approach yet.
- CuriouslyC 9y agoThe brain is slow in "cycles"/second, but the amount of computation done by each cycle isn't directly comparable to that done by a computer. Forgetting isn't a bug, it's a feature. Forgetting is basically like dimensionality reduction on input data - we extract the principle components/exemplars, remember a weighting, and trash the redundancy. Training a ML model is a lot faster on smaller data, and the same is true for us. Don't compare ANNs with the brain strictly on a time/time basis. Time isn't the only factor, power consumption and heat production are also factors, and if you include them the brain comes out way ahead. People with an engineering background almost universally underestimate how freaking awesome biology is. Our brains are self-constructing, self-replicating, self repairing (mostly) hyper-efficient pattern recognition systems. The more we learn about them the more awesome we realize they are. Don't be so arrogant as to assume a few hundred years of engineering will universally eclipse hundreds of millions of years of evolution.
- mythrwy 9y agoEvolution creeps along. Engineering ability however appears to be growing exponentially. It took millions of years for the brain to reach the place it is now but it only took a few thousand years to get to the moon and create the Internet. I wouldn't count out the power of engineering because biology is complex. Particularly given ever more powerful tools of computation and communication that have only recently (historically speaking, not in lifespans of javascript frameworks) come on line.
- CuriouslyC 9y agoTwo points: - The first part of a sigmoidal curve looks exponential. - Evolution is massively parallel.
- eggie 9y ago> The brain is slow and redundant. It has to be like that because it is not produced in a factory - it is created by self replication. Self replication imposes strict limits and requirements on the type of brain that can be created. It is also limited by the efficiency that it must attain in order to operate under the energy conditions of our environment. The energy efficiency of biological systems might be a hint that we should more-directly employ them in the "artificial" minds we build. You're right that the human brain is limited because of its context, but we'll only get superhuman hard artificial intelligence when we're able to build/grow a big one in a vat. > A neural net like ResNet-150 is capable of doing essentially what 1/3 of the brain is doing (vision). Is it? There is probably a lot more going on in that 1/3 of our brain than mapping images to words.
- danmaz74 9y ago> A neural net like ResNet-150 is capable of doing essentially what 1/3 of the brain is doing (vision) Oh come on.
- 21 9y ago> A neural net like ResNet-150 is capable of doing essentially what 1/3 of the brain is doing (vision) I'd say ResNet-150 is far from solving human vision, in the edge cases. Can it distinguish between a baseball texture and an actual baseball? How about between an actual cat versus a toy cat? Sometimes you want the two to be in the same category, other times you don't. The human can put the same two images in the same or in different categories, based on the higher task at hand. Neural networks are far from that, because they don't (yet) have a model of the world.
- deleted 9y ago[deleted]