6 ms·
this really suggests that while neural networks are good, they aren't doing what we are doing when we classify images.
by dnautics 11y ago
this really suggests that while neural networks are good, they aren't doing what we are doing when we classify images.
- shoo 11y agoi have a vague suspicion, without evidence, that many of these systems are trained to overfit their training sets horrendously. i won't claim that all networks overfit the data, but i suspect the methods tend to be prone to overfitting more than other methods that have far less parameters to optimise. this doesn't really matter in order to generate a bunch of fun pictures and visualisations.
- blazespin 11y agoMaybe, it's hard to say. I remember when my kids were really young they used to see really random things in clouds and sand or whatever - just like a neural net would.
- kuschku 11y agoThere’s even a name (and a subreddit) for the phenomenon: https://www.reddit.com/r/pareidolia https://www.reddit.com/r/pareidolia It shows that a human brain is just a neural network with decades of training.
- dnautics 11y agoconvnets are based off of the structure in the visual cortex, so there are likely some low-level similarities. It's the high-level processing that I doubt.
- Houshalter 11y agoWell we don't know that for sure. No one has been able to run backpropagation through the human brain, and find the exact right set of inputs that would fool us.
- deleted 11y ago[deleted]
- eli_gottlieb 11y agoWe know the human brain doesn't learn via backpropagation of errors. Biology can't implement a "global" algorithm of that sort, it needs a local, cell-to-cell learning rule.
- p1esk 11y agoNo, we don't know that. Take a look at this paper: http://arxiv.org/abs/1411.0247 http://arxiv.org/abs/1411.0247
- Houshalter 11y agoThere are many theories on how the brain learns, including variations of backpropagation. We don't really know anything. Here's a relatively recent theory by Hinton: https://www.youtube.com/watch?v=kxp7eWZa-2M&feature=youtu.be&t=38m13s https://www.youtube.com/watch?v=kxp7eWZa-2M&feature=youtu.be... Regardless, this has nothing to do with how the brain learns, but rather the function it has learned. Even if a neural network somehow used entirely local learning rules, it could still be exploited with this method.
- eli_gottlieb 11y ago>Regardless, this has nothing to do with how the brain learns, but rather the function it has learned. The learning rule and the hypothesis class together dictate what sort of function is learned. >Even if a neural network somehow used entirely local learning rules, it could still be exploited with this method. Yes, which is why current neural networks may not be the best learning method.
- Houshalter 11y agoThis method is basically just fuzzing with a really efficient method to do it quickly. But in theory you could try every possible set of inputs into the human eye, and it's quite possible you would find images like this, where only slight changes to the inputs cause entirely different outputs. But we can't try every possible set of inputs to human eyes. So we don't actually know how fragile human brains are. I suspect that brains use similar tricks to artificial neural networks, and learn similar functions.
- empath75 11y agoThe primary difference is that we have brains that do other things besides classifying images. We know things about the world that help us clarify ambiguous visual input. I think going forward that we're going to improve these things by linking more, different kinds of neural networks together.
- simonh 11y agoExactly. These neural nets have no concept of what a dog, vulture or trash can are, what properties that have, even what they are like as three dimensional objects. Many people reading about image classifiers assume that the networks are performing the same task humans do in the same way, but they are actualy worlds apart.