3 ms·
It seems like all adversarial examples I've seen so far are enabled by networks overfitting to small-scale features. By overfitting I mean that they give more i
by blauditore 9y ago
It seems like all adversarial examples I've seen so far are enabled by networks overfitting to small-scale features. By overfitting I mean that they give more importance to details compared to humans, who recognize much more the image as a whole.
Maybe the problem could be mitigated by penalizing "direct" responses to small-scale features while training, which is not a trivial thing to do though. One approach I could think of is training with multiple altered versions of the image, e.g. various amounts of blur, noise and mean/median filters applied. Or the other way around: To be more confident about a result, scale down the image to a fraction of it's size, run detection on that and compare results.
Are such techniques in use, or being researched on? I'm not too much in the loop about those topics.
- rahimnathwani 9y ago"training with multiple altered versions of the image, e.g. various amounts of blur, noise and mean/median filters applied" "Are such techniques in use" Yes, it's called 'data augmentation': https://medium.com/towards-data-science/deep-learning-3-more-on-cnns-handling-overfitting-2bd5d99abe5d https://medium.com/towards-data-science/deep-learning-3-more...