First they were designed to mimic nature, then these patterns (gabor filters) astonishingly automatically developed themselves via backpropagation (which gave r

First they were designed to mimic nature, then these patterns (gabor filters) astonishingly automatically developed themselves via backpropagation (which gave rise to the recent enthusiasm). Modern networks are instantiated with random noise but end up pretty much the same as previously hardcoded filters.