> I believe the reason this is happening is that given training data composed of structured images, the convolutional architecture heavily favors learning filt

> I believe the reason this is happening is that given training data composed of structured images, the convolutional architecture heavily favors learning filters which reflect geometric features, as opposed to random filters which can memorize the data And interesting idea, but you really need to test this out before assigning any particular confidence to this actually being what is happening.