4 ms·
One more relevant note - (Olshausen and Field, 1997) showed that the filter employed by V1 simple cells could be learned using some simple assumptions about spa
by andbberger 9y ago
One more relevant note - (Olshausen and Field, 1997) showed that the filter employed by V1 simple cells could be learned using some simple assumptions about sparse coding and a single image. Translation invariance built in by way of the sampling scheme of the image, small patches.
The filters learned by the first layer of CNNs is usually of the same type, Gabor filters. Not a coincidence.
That was twenty years ago. What's old is new?
- eref 9y agoWhat do Gabor filters have to do with this?
- ska 9y agoParent is saying Gabor filters are typically effectively recapitulated by the first layer of of the network anyway, as they are a natural representation.
- eref 9y agoBut what does have to do with smoothness and translation invariance which this paper is a demonstration of? You even learn Gabor filters with local connectivity without spatial weight sharing.