3 ms·
>> If we get to the point of having a human connectome to analyze-- or the kind of access to neural topology that a neural lace would provide-- could an optimiz
by YeGoblynQueenne 9y ago
>> If we get to the point of having a human connectome to analyze-- or the kind of access to neural topology that a neural lace would provide-- could an optimizer generate an image of static that human would mistake for the president of the United States?
Probably not, because our brain doesn't seem to work like Artificial Neural Networks do. Most notably, we learn to identify novel objects after only seeing a single example of them while ANNs may require many thousands of examples. We don't seem to learn to identify individual pixels, either (though what exactly our brain does when we learn to identify objects from their images is anyone's guess).
Digital images are also not a very good analogy for what human eyes see: our vision doesn't have "pixels" and we don't even need images to be particularly clear to identify them with good accuracy (we can still tell what things are up to a point, even in the dark, when it rains, when our visual field is occluded etc).
Generally, you can't expect the human brain to work like an ANN. Like others have said before [1], the "neural network" analogy is not a very good one. It often serves only to create confusion about the capabilities of ANNs and the human brain.
________________
[1] https://spectrum.ieee.org/automaton/robotics/artificial-intelligence/facebook-ai-director-yann-lecun-on-deep-learning https://spectrum.ieee.org/automaton/robotics/artificial-inte...
Yann LeCun: My least favorite description is, “It works just like the brain.”
I don’t like people saying this because, while Deep Learning gets an inspiration
from biology, it’s very, very far from what the brain actually does. And describing
it like the brain gives a bit of the aura of magic to it, which is dangerous. It
leads to hype; people claim things that are not true. AI has gone through a number
of AI winters because people claimed things they couldn’t deliver.
- amelius 9y agoYes. Convolutional networks is probably not how the brain does it. I guess instead it takes a brute force approach, where more parameters need to be trained.
- xapata 9y agoFurther, humans also use non-visual information when interpreting sights.
- Houshalter 9y agoI think the differences between ANNs and BNNs are exaggerated. I think they probably work on similar principles. Even if there some differences. But none of that is particularly relevant. Even if they are completely different, so what? The same procedure could still work. Take a biological brain and backprop through it to find exactly what inputs change the outputs by some small degree and tweak it bit by bit until you change the output. You can apply this to any function, it's general. Adversarial examples are exceedingly rare in natural data. They require tweaking exactly the right pixels in exactly the right direction. It's something stupid like a one in a billion billion chance of such a malicious example occurring by chance if you just randomly add noise to images. It requires a very precise optimization procedure. So if adversarial examples did exist for human vision, we probably wouldn't know it yet. They don't occur in nature. So there's no reason for the brain to have evolved defenses against them. (Though camouflage is an interesting natural analogy, it's not quite the same.)
- YeGoblynQueenne 9y ago>> Take a biological brain and backprop through it to find exactly what inputs change the outputs by some small degree and tweak it bit by bit until you change the output. How exactly do you "backprop through" a (biological) brain? Also, I don't see why you'd ever want to do that "tweak it bit by bit" thing to a brain. Human brains seem to catch on to ideas pretty quickly. They don't need to go back and forth on their synapses a million times until they learn to react to a stimulus. Whatever the brain does is light years ahead of backprop, which is, all things considered, a pretty poor algorithm. So why would you ever want to do that "backprop on a brain" thing, if you could do- you know, what brains do normally?
- Houshalter 9y agoIf you have a perfect simulation of it, you can just run it step by step and create a computation graph and go backwards through it. The algorithm used to do the optimization doesn't really matter. Use a GA or hillclimbing if you want. EDIT since you added more to your comment: >why you'd ever want to do that "tweak it bit by bit" thing to a brain. Human brains seem to catch on to ideas pretty quickly. So what? That's the process for creating an adversarial image. Does it matter how many steps it takes to create it? >They don't need to go back and forth on their synapses a million times until they learn to react to a stimulus. That's exactly how learning works in humans. Try to learn to juggle with just one or two tries. It takes thousands. And that's after you've spent years in your body learning how to coordinate your muscles and locate objects with your eyes and how physics works, etc. >Whatever the brain does is light years ahead of backprop, which is, all things considered, a pretty poor algorithm. I really really doubt that. There are a number of theories about how the brain might implement a variation backpropagation for learning. Hinton has one. Backpropagation is not a poor algorithm, it's probably close to optimal. No one has been able to come up with something better besides just little heuristic tweaks. It's very difficult to see how you could do so. It's so simple and elegant and general.