3 ms·
It's worth noting that this would usually trivial to protect against in practice by checking any attack vector against multiple different neural networks (ideal
by nl 11y ago
It's worth noting that this would usually trivial to protect against in practice by checking any attack vector against multiple different neural networks (ideally trained with different(ly permutated) data, and different architectures).
Having said that, the MNIST examples might fool multiple networks. But one should note that the "3" example would probably fool a lot of humans on a single casual glance.
Also, this paper gives an excellent way to build a feedback for adversarial training (maybe some kind of semi-supervised auto encoder thing?)
Edit: I noticed that Ian Goodfellow is a co-author of [1] so he's probably thinking about the adversarial training idea.
[1] http://gitxiv.com/posts/eFw3ArCyvhaFJ6bzb/adversarial-autoencoders http://gitxiv.com/posts/eFw3ArCyvhaFJ6bzb/adversarial-autoen...