3 ms·
Attacks against computer vision algorithms are pretty much always going to be of the form of "I can make a change to the scene or image which makes no differenc
by Spivak 9y ago
Attacks against computer vision algorithms are pretty much always going to be of the form of "I can make a change to the scene or image which makes no difference to a human but which causes an erroneous classification."
This is a huge problem if we expect autonomous systems to do anything meaningful with vision outside of tightly controlled environments. You're going to be crucified after an autonomous vehicle merrily plows into a semi and the explanation for the crash is "well the truck was white and had the Hidden Valley logo on it which was misinterpreted as clouds." Or if an autonomous car runs a red because there was billboard somewhere behind the light which sorta-kinda looks like a green circle.
- psychometry 9y agoOr meddling kids put stickers on stop signs that make them look like no parking signs to an Uber automated car.
- wrsh07 9y agoSemi relevant xkcd: https://xkcd.com/1958/ https://xkcd.com/1958/ But these attacks are worth thinking about, and it is definitely useful to build systems that are robust to this type of meddling.