4 ms·
>> This tendency leads people to expect something from AI that they can do quickly and to be shocked when we find AI to be brittle and lacking fundamental fea
by YeGoblynQueenne 9y ago
>> This tendency leads people to expect something from AI that they can do
quickly and to be shocked when we find AI to be brittle and lacking
fundamental features of human understanding.
Just to be clear- "AI" ≠ classification and even more so, AI ≠ machine
learning ≠ deep neural nets. The article above runs fast and loose with the
terminology, but machine vision and in particular object detection (or
classification of objects in images) is one area and one sub-task of AI in
general. It happens to be one of the two or three areas that have seen strong
empirical results in recent years, but it's by no means the only active area
of research (although, thanks to the funding from large technology companies,
it is probably the fastest growing one).
It's also very strange to see "brittleness" as a criticism of deep neural
networks in particular (the attacks described only work on convolutional
neural nets as far as I know). In the past, the type of AI system criticised
as "brittle" was the hand-crafted rule-based expert system type of AI. And the
reason why that kind of AI was criticised as brittle is because it did not
deal very well with the noise in real-world domains, such as in photography or
speech etc. Deep neural nets in particular are extremely robust to noise,
which is why they work so well in speech and image processing.
I think what you really mean by "brittle" is the tendency of deep nets to be,
well, a little too good in dealing with noise. Specifically, they have a
tendency to overfit to the noise, because they produce models with very high
variance. Indeed, the whole adversarial examples thing is probably best
understood as a result of overfitting.
As to "lacking fundamental features of human understanding" what you mean, I
think, is that image classifiers only do classification and nothing more- which
is true, but then that's what they 're designed to do. Nobody expects an image
classifier to have any understanding of the images it's classifying.
- chubot 9y ago"Brittle" is easy to explain: they're wrong in ways that a human would not be wrong. That goes for both rule-based systems and deep neural nets. Humans are inherently social; we have a model of how other humans behave which is essential to getting things done. It doesn't involve say mistaking a bunch of white noise for a camel. For another example, when you're driving, don't underestimate how many of the rules are not written down and involve a model of what the other driver (human) might do. Those rules are also specific to a geographic area and evolve (slowly and imperceptibly) over time. The question "Is this person going to be surprised by what I do?" is inherently different than "Is this object a cyclist?"
- mycall 9y agoThere are more attacks than just overfitting errors for visual domains. Mirrors, lasers, [transparent] masks, costumes, environmental conditions (many factors here), high speed motion, twins, polymorphic objects, optical illusions, color inversions; and that's not even getting into behavior variations. Once DNN can handle all of these things, they will be so deep and varied, they could easily have more hallucinations because of their growing complexity, trying to adapt.
- xapata 9y ago"Overfitting errors" is not an attack. Handling these oddities will most likely require a strategy of smoothing out the complexity, rather than deepening it. My guess is that solving one of these kinds of problems will solve most or all of them together.
- wodenokoto 9y agoMachine learning does include neural networks of all depths.
- Eridrus 9y ago> (the attacks described only work on convolutional neural nets as far as I know). These attacks work on basically every classifier. It works for multi-layer perceptrons, it works for linear models, it works for random forests, it works for SVMs. It works on basically anything that tries to generalize far from the points it is trained on. There are a lot of super interesting results in this area, but it's practical significance is waaaaaay over-hyped. One cool thing I saw recently was that some researchers made a physical turtle statue with a texture on it that fooled ML systems into thinking it was a gun, with I think the implication that you could make an AI system think a gun was a turtle, but you could also just put a gun in a turtle case, which fools humans as well as AI systems.
- JimmyAustin 9y agoI think part of the implication was the opposite, a turtle that was registered by AI systems as a gun, potentially triggering a automatic “swatting” response.
- Eridrus 9y agoOut of all the ways to mess with someone, this seems pretty complicated and unreliable.
- hidden-markov 9y agoThe adversarial example attacks work against most known machine learning models, including statistical models, decision trees, feed-forward nets, convolutional nets, recurrent nets. They not only work against classifiers, but also against regression, and RL models.