3 ms·
There was a paper that claimed those sorts of rotations and movements can help alleviate adversarial examples: https://arxiv.org/abs/1707.03501 https://arxiv.o
by moyix 9y ago
There was a paper that claimed those sorts of rotations and movements can help alleviate adversarial examples:
https://arxiv.org/abs/1707.03501 https://arxiv.org/abs/1707.03501
However, OpenAI quickly refuted it by creating adversarial examples that continue to fool the classifier even when rotated, scaled, etc:
https://blog.openai.com/robust-adversarial-inputs/ https://blog.openai.com/robust-adversarial-inputs/
So it looks like there's no "easy" way out here. Multiple types of sensors may help, but it seems likely that it will still be possible to construct examples that fool network over all sensor inputs at once.
Ian Goodfellow and Nicolas Papernot have a good blog on machine learning security issues. One relevant post on why this is such a hard problem:
http://www.cleverhans.io/security/privacy/ml/2017/02/15/why-attacking-machine-learning-is-easier-than-defending-it.html http://www.cleverhans.io/security/privacy/ml/2017/02/15/why-...
- pishpash 9y agoIs it a big surprise that you can construct adversarial examples for algorithms? Don't humans have the same class of problems with optical illusions? And those are not even adversarial, just confusing. If we constructed truly adversarial examples for human neurology, I bet they would be equally insane.
- blauditore 9y agoIn some sense, yes, optical illusions are simlar to such "adversarial examples". But if you think about it, any kind of image is somewhat delusive, since we perceive it as whatever object it depicts while actually staring at a piece of paper with some ink on it. Also, adversarial in this case seems to refer to images perceived differently by machines than by humans, so it's not really possible to create such ones for humans.
- kthejoker2 9y agoNo, adversarial simply means deliberately trying to engineer false positives and negatives. This can be done against humans, machines, ants, trees, viruses ...
- blauditore 9y agoWhat is a false positive or false negative in this case? The "ground truth" here is what human perceive.
- kthejoker2 9y agoOptical illusion?
- bluewolf_sk 9y agoWait... the dress was blue and black?
- robotresearcher 9y agoCamouflage is an adversarial example.
- thedevil 9y agoThank you for your awesome response. It probably would have taken me hours of googling and reading to find these exact posts. A mere upvote is not enough of a thank you for such a quality reply.