3 ms·
When the problem of adversarial examples will be solved, AI will have leapt one more step ahead. It's clear right now that adversarial examples are the elephant
by visarga 9y ago
When the problem of adversarial examples will be solved, AI will have leapt one more step ahead. It's clear right now that adversarial examples are the elephant in the room. It's a make or break situation for the field but I think it will come out stronger. We're grasping at the limits of our neural network technology, trying to discriminate between ghosts of perceptions.
I think the solution will come from marrying a top-down approach to the bottom-up one we're using right now. We need more prior knowledge about the world. We need to be able to simulate situations and understand their effects. Maybe what we're lacking right now is a mental simulator of the world, an imagination module. Coupling perception with imagination would reduce the sample complexity as well.
Interesting to note that the researchers that started the adversarial examples craze and invented the imagination module (GAN - generative adversarial network) are one and the same - Ian Goodfellow. He was right on the spot to identify the weak point of deep learning.