3 ms·
>> how many generations of selective breeding do you think it would take to evolve a spider that could beat the best humans at go? That's a different issue. Sp
by YeGoblynQueenne 10y ago
>> how many generations of selective breeding do you think it would take to
evolve a spider that could beat the best humans at go?
That's a different issue. Spiders, as all insects, don't learn.
It seems that insects have some kind of firmware-style programming that can't
change, because they don't have the cognitive ability to change it. This
firmware can be unbelievably complex, like in the case of Portia spiders
stalking prey, but it can't develop any further, at least not on the
individual level.
Even this however is nothing short of amazing. The truth is that we haven't
developed a single program that can do what a Portia spider can do, and in
fact learning algorithms (or strategies) like reinforcement learning are our
best bet to avoid having to explicitly write down the rules for this sort of
behaviour. And we want to avoid having to do that because it's probably beyond
our abilities.
The learning algorithms we have right now however aren't a very good way to
develop intelligence that can display such complex behaviours. Those
algorithms are one-trick ponies, they learn to do one thing very well but if
you want to do more than one thing you need to train more instances of the
algorithm- and then you need to find a way to combine the trained instances in
a cognitive architecture. And on that we haven't made much progress yet.
- Houshalter 10y agoThat's exactly my point. Spiders can't learn. Maybe they are amazing for what they do, but the comparison is apples to oranges. They do fundamentally different things. Of course spiders are complex. Everything in biology is complex. It's been slowly refined over millions and millions of years. Countless trillions of tweaks to its DNA tested and rejected until it hit upon something that worked. No human could design something as complex as a spider. Our artificial neural networks are just as complex though. AlphaGo probably knows millions of facts and heuristics about Go. You would never be able to understand everything it knows. Even though we didn't create the complexity ourselves, we "evolve" it just like the spider, sometimes even with algorithms based on evolution. But we have much more efficient algorithms than that, like backprop.
- Cybiote 10y agoThe large majority of deployed machine learning algorithms actually can't learn. The bias is so large that most (all?) specialized hardware assumes that only inference will be done. In contrast, there is evidence for online adaptability in insects^ ^ http://www.annualreviews.org/eprint/5PHddkgYYKaduPp4CcN5/full/10.1146/annurev.ento.53.103106.093343 http://www.annualreviews.org/eprint/5PHddkgYYKaduPp4CcN5/ful...
- Houshalter 10y agoThey learn just fine during training.
- YeGoblynQueenne 10y ago>> The large majority of deployed machine learning algorithms actually can't learn. Learning algorithms construct a model of data- that's what we call "learning", or "training". The trained model is then used to make decisions, so that's what you would deploy in a production system. In that sense the deployed systems don't learn any further, yes, but that's because you don't deploy the algorithm per se. An exception is what is known as "online learning" algorithms, that can continuously update their model as new data becomes available (hance, "online").
- Cybiote 10y agoI took care to point out deployed models. I did not say the models did no learning. In fact, one can draw an analogy from evolution and instinct to offline training/hyperparameter search/architecture tweaks and deployed model. And, technically, the manner by which most nets are trained, via (minibatched) stochastic gradient descent is online. But the architectures are so ill-adapted to learning continuously and backprop is so data inefficient that retraining on new data is often just better done from scratch (or at best, freezing weights).
- YeGoblynQueenne 10y ago>> Our artificial neural networks are just as complex though. I don't know about that. I think it depends on how you count the complexity of a model. There's three cases: a) insects are less complex than machine learning models, b) both are equally complex, c) insects are simpler. If (b) or (c) is the case then we're shafted, because we're failing to reproduce insect behaviour despite building systems at least as complex as theirs. If (c) is the case, we're particularly screwed because it means we're missing a simple, more efficient way to do things. If (a) is the case then we may have a hope to get to where insects are in terms of complexity and possibly reproduce their behaviour. Still, there's the issue of combining models to perform well at a broad range of tasks, which is far from solved.
- bbctol 10y agoIn terms of number of nodes, complexity of the arrangement of nodes, and amount of computation performed by each node, even a small biological brain is incalculably more complicated than a top ANN.
- singularity2001 10y ago>> Spiders, as all insects, don't learn. That is blatantly false. A recent paper has shown that bees can even be trained to distinguishing a handful of human faces( a task which they are of course not optimized for). for starters: http://insects.about.com/od/behaviorcommunication/f/caninsectslearn.htm http://insects.about.com/od/behaviorcommunication/f/caninsec...
- whamlastxmas 10y agoIt might be more accurate to say that bees have the innate ability to distinguish and remember faces. An insect cannot learn a novel concept they are not able to do innately.
- gpderetta 10y ago> That's a different issue. Spiders, as all insects, don't learn. But portia spiders do seem to exhibit learning behavior. While they have preprogrammed strategies for common preys, they do attempt to catch unfamiliar preys and seem to learn from their mistakes and come up with new strategies.
- YeGoblynQueenne 10y agoThat's planning, not learning. An instance of learning would be training a spider to play Go, say.
- Teever 10y agoWhat is the difference between planning and learning, and would you consider a human that is unable to learn something like general relativity because they are mentally retarded to be unable to learn?
- dTal 10y ago>Spiders, as all insects, don't learn >Spiders >insects For shame!
- YeGoblynQueenne 10y agoFine, fine: >> Spiders, as all arthropods, don't learn. Better now?