3 ms·
Same thing as the brain pretty much, except we have root control over the NN in a way we don't with the brain. To my knowledge, some angles have been explored.
by sdwr 3y ago
Same thing as the brain pretty much, except we have root control over the NN in a way we don't with the brain.
To my knowledge, some angles have been explored. Finding which inputs maximally stimulate indiv neurons, and tracing that up the chain.
There was a fantastic article that did this on ImageNet - the takeaway was that neurons adjacent to the input encode sharp, basic features (like edges), and "higher-level" ones encode more nuanced stuff (textures, fur, wheels).
Then ablations, as you mentioned. And finally, rerunning the same training data on differently sized + shaped architectures.
AI systems are missing at least one level of complexity. All neurons in a NN layer fire simultaneously, unlike brain neurons, which trigger each other async.
- janalsncm 3y agoThe brain is heterogenous in ways that a neural network needn’t be. Certain brain regions definitely perform certain functions, certain regions are hardwired to other regions. You can chop out a chunk of a person’s brain and they’ll be completely unable to do certain things. Afaik the properties you’re referring to on AlexNet (the network trained to perform on Image Net) have to do with the nature of repeated convolution operations which, while interesting, is not as deeply insightful as I believe the article is aiming for.