4 ms·
You might find this 1996 Nature paper by Olshausen & Field interesting. In it, they describe how a coding strategy that maximizes spareness when representing na
by suchow 10y ago
You might find this 1996 Nature paper by Olshausen & Field interesting. In it, they describe how a coding strategy that maximizes spareness when representing natural scenes is enough to produce a family of localized, oriented, bandpass receptive fields, like those found in the early visual system of humans.
https://courses.cs.washington.edu/courses/cse528/11sp/Olshausen-nature-paper.pdf https://courses.cs.washington.edu/courses/cse528/11sp/Olshau...
- happycube 10y agoSuperficially, those graphics look a lot like visualizations of conv nets.
- argonaut 10y agoThis fits in with my point: they imposed several restrictions about the model space: maximizing sparseness, and they also make several linearity assumptions.
- eli_gottlieb 10y agoGreat, now I've got another paper to cite. Thanks!
- trhway 10y agothose papers should be, if not 101, at least 201 for neural net track as it would help to establish common framework and basis for thinking, talking and analysis of neural nets machinery.