Yeah but those properties are exactly what you would expect from imitation learned fuzzy neuronal classifiers. As such, they have no deeper meaning than saying

Yeah but those properties are exactly what you would expect from imitation learned fuzzy neuronal classifiers. As such, they have no deeper meaning than saying "does the fact that the deep learning model thinks this traffic cone is a penguin reveal to us a deep truth about traffic cones and penguins?" No.. It just used some shortcut feature that's not universally applicable. Just like us. The heap classifier works to tell that obvious heaps are heaps. It works to tell that single items are not heaps. In between, there is no meaning but noise.