2 ms·
Sure, it's always good to dig deeper and find out where a correlation comes from. But the question isn't just whether it's true, but also whether it will stay
by skybrian 9y ago
Sure, it's always good to dig deeper and find out where a correlation comes from.
But the question isn't just whether it's true, but also whether it will stay true. As they say in finance, past performance does not guarantee future results. We are not talking about the laws of physics here. There are historical correlations that it's unsafe to rely on, particularly when people are trying to change them.
Part of this is overfitting, but there's also the problem of drift. A model may stop working well because the world has changed.
So some correlations can be rejected just because we don't have confidence in them. It's a dependency that looks too fragile.