17 ms·
I think it's pretty clear that neural networks are developing concepts/abstractions of the object it's classifying. Check https://distill.pub/2017/feature-visu
by chillee 9y ago
I think it's pretty clear that neural networks are developing concepts/abstractions of the object it's classifying.
Check https://distill.pub/2017/feature-visualization/appendix/ https://distill.pub/2017/feature-visualization/appendix/
I think some of the filters are pretty clearly developing "higher levels of abstractions".
- argonaut 9y agoIt's not an interesting question whether networks learn abstractions. It's almost tautological - an image classification network will by definition (attempt to) distill an image into a distribution over categories. So when people criticize abstraction I think they are really criticizing the quality of the abstraction... Because the key phrase in the grandparent post is "really represent or mean." Grass + white strands = sheep, is a hierarchical abstraction, but it's a bogus one. Feature visualizations do not answer this more relevant question.