6 ms·
this is wrong. look at the size of an elephant brain. they are smart, but not smarter than humans. similarly, bird brains are tiny, but birds have shown signifi
by modzu 8y ago
this is wrong. look at the size of an elephant brain. they are smart, but not smarter than humans. similarly, bird brains are tiny, but birds have shown significant intelligence, crows in particular have been well studied.
- melling 8y agoThe point is that we're trying to duplicate something with the ability of the human brain, and we aren't constrained by size. We can cheat (e.g. 1,000,000 times bigger with 1,000,000 times the power, etc). We're just missing an algorithm or two.
- modzu 8y agoah yes, it's true we can keep adding on processors and memory until we go beyond what's in the brain (i think currently deep mind has ~ 11 billion neurons to our 100 billion), and indeed so far it's helping, but my point is that it's not at all clear that "more = better". there is more complexity involved than simply scale. the machine could become schizophrenic for exmaple (seriously).
- deleted 8y ago[deleted]
- riku_iki 8y ago> in the brain you focus only on single brain, when really we need to look at many trillions brains and experiments with complex reward function(real world): billion years of evolution * billions of various creatures born and died within every year. All this giant sequence of experiments converged to current human brain. In ML terms: to achieve result similar to human brain we need to run that many hyperparameter optimization trials. Or find some better shortcuts than human brain biological structure.
- vl 8y agoThis is not a best way to compare it: brain neurons do orders of magnitudes less operations per second. Current Google's TPU clusters are 10 petaflops, with new ones being 1 exoflops. We can estimate 100Hz frequency for brain, so 100 * 10^11 = 10^13 "neuron operations". Let's estimate 1000 flops to simulate single neuron. So it gives us 10^16 flops for brain (aka 10 petaplops). I.e. Google's new deployments are more powerful than single brain.
- modzu 8y agoand what says that is the best way to compare it? neural networks don't model anything but the electrical synapse. there's much more going on (cf: chemical synapse). also speed isn't the holy grail: too fast in a human brain and you get seizures. why? it could be that as these systems scale up magical things happen. but it's a conjecture -- something we will discover, and not something we know.
- gipp 8y agoThere are many other factors at play, yes, but physical size does impose information-theoretic upper bounds on its processing power. Bounds we're nowhere near probably, but still they are there.