4 ms·
> But not so fast. B, for instance, might be correlated with A. In this case, the coefficients are also correlated and interpretability becomes much more nuance
by jgalt212 8y ago
> But not so fast. B, for instance, might be correlated with A. In this case, the coefficients are also correlated and interpretability becomes much more nuanced. And this isn’t the exception, it’s the rule. If you have a lot of features, chances are many of them are correlated.
Aren't we supposed to remove correlated predictors from models?
Or we can use techniques like PCA? But then, once again, we fall into the realm of unexplainable.
- shoguning 8y agoYou can remove correlated predictors or do stepwise regression to get a minimal model with more intelligible coefficients. The problem is it's still difficult to determine direction of causality. That's why controlled experiments are so important.