4 ms·
The video example of a turtle being misclassified as a rifle is pretty scary https://www.youtube.com/watch?v=piYnd_wYlT8 https://www.youtube.com/watch?v=piYnd_w
by daenz 9y ago
The video example of a turtle being misclassified as a rifle is pretty scary https://www.youtube.com/watch?v=piYnd_wYlT8 https://www.youtube.com/watch?v=piYnd_wYlT8
We're approaching a world where AI will be more and more relied upon in dangerous situations. Imagine someone getting killed for something ridiculous like inadvertently holding an adversarial example. Public trust would have a hard time recovering.
- doener 9y ago>Imagine someone getting killed for something ridiculous like inadvertently holding an adversarial example. This would never be the case with humans, right? No.
- oh_sigh 9y agoWould adding random noise to an image before running it through the classifier mitigate these kinds of attacks?
- yorwba 9y agoNo, ironically because classifiers are trained to be robust to noise. Adversarial examples are generated by altering the original in one specific dimension of a high-dimensional vector space. Random noise is vanishingly unlikely to undo that transformation, so the classification will stay wrong.