Adding random noise doesn't help a lot, because it's random. Mean 0. This technique relies on changing each pixel in just the right direction to affect its outp

Adding random noise doesn't help a lot, because it's random. Mean 0. This technique relies on changing each pixel in just the right direction to affect its output. Random noise pushes half the pixels back to the original direction and the other half even further in the wrong direction. It's unclear if viewing the image at different scales or from different angles would help. Likely it would. However NNs are designed and trained to be as invariant to deformation as possible. A more interesting domain is audio. Audio doesn't have any concept of different rotation or scale. It's guaranteed each bit will be input in the correct order. Its also a recurrent system, which is vulnerable to falling into states of chaotic behavior. So if humans are vulnerable to these things, it will likely be in the form of audio.