4 ms·

You could say that all perceptual illusions are adversarial inputs for the human senses. They're just not damaging ones. In a lot of adversarial input stuff fo

by schoen 7y ago

You could say that all perceptual illusions are adversarial inputs for the human senses. They're just not damaging ones. In a lot of adversarial input stuff for AI, you're trying to get the AI to misclassify something, not necessarily to damage the AI or even change its learning at all. In Snow Crash the perceptions were definitely damaging to the perceivers, but I don't think you have to go nearly that far to have adversarial inputs!

jacquesm 7y ago
True, but it was just the Snow Crash like ones that I had in mind. There are also adversarial attacks possible on all the other senses once you understand how they work at a physical or pre-processing level. You can make something cold feel hot, trigger speech patterns to go off by pre-setting them with auditory patterns, cause people to hear sounds that aren't there and so on. Given how many of these pathways are buggy it is quite impressive how well the brain can make sense of its surroundings. Mimicry in the animal kingdom is another 'adversarial input' that has potentially damaging effects on the perceivers (hunger!) but it is very much a defensive mechanism so that probably should not count either.
- wizardforhire 7y ago
  True nothing like snowcrash has yet to be created to any of our knowledges. Of course... if it was... how would we be able to respond to this thread! But this is whole other rabbit hole to go down that in light of some recents posts on the front page today doesn’t seem too fun.
hwbehrens 7y ago
I once read a piece of text whose contents was so vividly horrific that it caused me to momentarily pass out, falling out of my chair. Granted, it passed through an intermediate representation in my brain, but I would still count it as an adversarial input to my vision that caused lasting damage. The damage in Snow Crash just happened to be more severe than "short-term distress followed by periodic unsettlement".

by schoen 7y ago

jacquesm 7y ago

True, but it was just the Snow Crash like ones that I had in mind. There are also adversarial attacks possible on all the other senses once you understand how they work at a physical or pre-processing level. You can make something cold feel hot, trigger speech patterns to go off by pre-setting them with auditory patterns, cause people to hear sounds that aren't there and so on. Given how many of these pathways are buggy it is quite impressive how well the brain can make sense of its surroundings. Mimicry in the animal kingdom is another 'adversarial input' that has potentially damaging effects on the perceivers (hunger!) but it is very much a defensive mechanism so that probably should not count either.

wizardforhire 7y ago
True nothing like snowcrash has yet to be created to any of our knowledges. Of course... if it was... how would we be able to respond to this thread! But this is whole other rabbit hole to go down that in light of some recents posts on the front page today doesn’t seem too fun.

hwbehrens 7y ago

I once read a piece of text whose contents was so vividly horrific that it caused me to momentarily pass out, falling out of my chair. Granted, it passed through an intermediate representation in my brain, but I would still count it as an adversarial input to my vision that caused lasting damage. The damage in Snow Crash just happened to be more severe than "short-term distress followed by periodic unsettlement".