Yeah, there's also an likely apocryphal story about tanks and machine learning: https://gwern.net/tank https://gwern.net/tank The more you work with large-scal

Yeah, there's also an likely apocryphal story about tanks and machine learning: https://gwern.net/tank https://gwern.net/tank The more you work with large-scale ML systems the more you develop an intuition for these kinds of properties. If you work a lot with debugging models and training data, or even just dimensionality reduction and matrix factorization, you begin to realize that many features are highly correlated with each other, often being close to scaled linear.