4 ms·
It's simpler than that The human vision has a natural blur (some more than others), natural temporal integration of inputs, automatic centering of subjects, li
by raverbashing 9y ago
It's simpler than that
The human vision has a natural blur (some more than others), natural temporal integration of inputs, automatic centering of subjects, limited resolution and gain adjustment
Hence one pixel nudged makes absolutely no difference
- halflings 9y agoAll the things you've said, bar temporal integration, are also present in CNNs in some way. Training data is "augmented" with different levels of luminosity to cancel the affect that has on classification, pooling layers give some translation invariance (and avg pooling is a type of blur), and resolution is also very limited in most models (and gets smaller as you get deeper). And it still fails!
- raverbashing 9y agoAh yes, but I mean there are two types of temporal integration One is the short-timed "persistence of vision" one The other is observing a scene multiple times by slightly different angles and positions If some weird arrangement causes an illusion, changing the position slightly usually fixes that Also, human data is noisy, I guess augmentation strategies might want to consider that as well
- scottlegrand2 9y agoSo here's an idea to test that. Take an image and find one of these adversary generating pixels. Now take that same corresponding pixel and modify it in each of the other images in exactly the same way that generated the first adversary. I would not be surprised if it is not an adversary generator across all images. I would expect each of those images has a different gradient.
- taneq 9y agoI've often thought that DNN vision systems would be much more robust if they worked on video streams rather than single-image snapshots, for just this reason. It would let them implement something like the "liveness tests" the new iPhone apparently applies to the facial recognition unlock stuff.
- mattkrause 9y agoIt's definitely true that segmentation is a lot easier to do for video than images, in part because you have access to more information (e.g., motion cues from an object moving independently from the camera).
- Houshalter 9y agoSo 2 pixels or 4. Lower resolution is no protection, it just means the pixels are larger.