5 ms·
>> We have a vision net like computers that can be fooled with the same tricks (just google "optical illusion"). I don't know of any optical illusions where a
by YeGoblynQueenne 8y ago
>> We have a vision net like computers that can be fooled with the same tricks (just google "optical illusion").
I don't know of any optical illusions where a bus turned upside down is perceived as a plowshare, or an image of an elephant superimposed on the image of a room causes the other objects in the room to be misidentified.
Human optical illusions reveal the structural bias in the way we see, but that has nothing to do with adversarial examples and overfitting to a few pixels.
- twtw 8y ago> a bus turned upside down is perceived as a plowshare If I'm thinking of the same picture you are, it's a schoolbus on its side on a snowy road that is misidentified as a snowplow. FWIW, that picture does look a lot like a snowplow to my eye. Big yellow rectangle against road cleared of snow? If I glanced at it, I might have said it's a snowplow.
- croddin 8y agoHere is the article with that image: https://medium.com/@GaryMarcus/the-deepest-problem-with-deep-learning-91c5991f5695 https://medium.com/@GaryMarcus/the-deepest-problem-with-deep... and the hn discussion: https://news.ycombinator.com/item?id=18577813 https://news.ycombinator.com/item?id=18577813
- endymi0n 8y ago> I don't know of any optical illusions where a bus turned upside down is perceived as a plowshare, or an image of an elephant superimposed on the image of a room causes the other objects in the room to be misidentified. I wouldn't be so sure about that actually. Observing my daughters, I'm sometimes extremely surprised about how they identify objects. As you grow, your concious mind probably simply does not notice the continuous cross-validation happening. Also, at the severe augmentation levels of years of ~50 fps "live video" training data, I can imagine there's another compensation algorithm at work in humans that tries to logically orient any picture into a most common, "upright" fashion before even trying to identify anything.
- YeGoblynQueenne 8y agoI don't understand what you mean by cross-validation. I'm guessing you don't mean actual cross-validation, where you test a model learned on a training partition against a testing partition, etc?
- tabtab 8y agoMaybe it's about context. One wouldn't expect to see a (realistic) elephant in a living room. For humans, if something seems "out of place", we tend to focus on it more to make sure we are interpreting it correctly. NN's have no sense of "out of place" other than "knowing" X and Y are not normally seen together in the training set. Humans give oddities "more CPU" (or run like heck to avoid being trampled and worry later about being right). We apply life experience and logic to explore it deeper. In the elephant case, the shadows look wrong also, which should trigger the "Maybe it's a cheap Photoshop job" module in our brain. But NN's don't understand the concept of cheap Photoshop jobs because they don't browse the web for cute kitten videos and fun but fake news like humans do. Maybe NN's can be trained for fake photo detection, but solving every identification hurdle of the human world by adding yet another dimension to the training step probably won't scale.
- Verdex 8y agoI'm not so sure. We have the entire industry of magicians devoted to making some pretty ridiculous illusions. Everyone knows it's fake on a conscious level. But the fact that everyone applauds this thing they know is fake is a pretty good proof that they are very impressed on a subconscious level. The human mind has a lot more potential inputs AND it also tends to have years or decades of experience to draw on as well. Give the AI a quadcopter to fly around in and a huge database and it's going to go investigate the mislabeled data and figure out that it was misled. Similarly people walk towards mirages looking for an oasis.
- YeGoblynQueenne 8y ago>> Give the AI a quadcopter to fly around in and a huge database and it's going to go investigate the mislabeled data and figure out that it was misled. What kind of AI is that? It has the ability to choose its own goals, to figure out when it's made a mistake and explore the world around it to correct its model of it? That's a pretty damn advanced AI. Edit: Btw, if you think that sort of thing can work and that all you need is an AI, a quadcopter and a huge database- why don't you try it? The rewards would be astronomical, well worth any investment.
- tabtab 8y agoRe: fly around...choose its own goals...explore the world around it to correct its model... "This is LearnBot. Human, I need to extract your spleen to learn how they differ from bladders. Please hold still..."
- Verdex 8y agoApparently, I was too vague. I'm not convinced that what I have in mind is this ambitious. 1) Database with objects likely to be found together and statistical weights next to them. 2) Image recognition that can link to the database from 1. 3) Lidar that will allow the quadcopter to map environment in 3D regardless of how it labeled objects. 4) Any object that shows up that shows a statistical unlikely placement triggers the quadcopter to fly around it in a circle in an attempt to get a different picture so that a relabel attempt can be made. I do admit that my total understanding of how good image recognition is isn't state of the art, but I thought there were some success stories. > Btw, if you think that sort of thing can work and that all you need is an AI, a quadcopter and a huge database- why don't you try it? The rewards would be astronomical, well worth any investment. This does sound a bit like, "If you're so smart why aren't you rich." I suppose I won't be able to implement the plan because A) I don't have access to massive databases that contain objects and the other objects they are likely to be found next to and B) I don't think my "fly around weird stuff and try to relabel" algorithm is likely to have a very good business model.
- hnick 8y agoStay awake long enough though and human image processing gets really messy. I personally mis-identify things as people or spiders when scanning a scene. My brain jumps to a conclusion before I have time to double check and refine what I see. I wonder what the mental model for that is - I've always assumed the brain iterates and refines but short-circuits when we're tired since processing is slower/limited.