5 ms·
> correlation and causation are unrelated This is incorrect (but what followed is correct). You have extended the meaning of the phrase "correlation does not
by godelski 2y ago
> correlation and causation are unrelated
This is incorrect (but what followed is correct).
You have extended the meaning of the phrase "correlation does not imply causation" to a stronger case[0]. The correct way to say this is that "correlation are not necessarily related."
The other way you might determine this was wrong is that ,,association''[2] always occurs when there is causation. So we have the classic A ⇒ B ⇏ B ⇒ A (A implies B does not imply B implies A), where ordering matters.
Last, we should reference Judea Pearl's Ladder of Causality[1].
[0] Another similar example was given to us by Rumsfield with respect to the Iraq WMD search. Where the error was changing "the absence of proof is not proof of absence" to the much stronger "the absence of evidence is not evidence of absence". It also illustrates why we might want to "nitpick" here https://archive.is/20140823194745/http://logbase2.blogspot.com/2009/01/absence-of-evidence.html https://archive.is/20140823194745/http://logbase2.blogspot.c...
[1] https://web.cs.ucla.edu/~kaoru/3-layer-causal-hierarchy.pdf https://web.cs.ucla.edu/~kaoru/3-layer-causal-hierarchy.pdf
[2] Edit for clarity: The reason I (and Pearl) use the word "association" rather than "correlation" is because in statistics "correlation" often refers to linear relationship. So association clarifies that there is mutual information. There might be masked relationships, so non-linear. But if we are to use the standard vernacular of "correlation" (what most people think) then we could correctly say "causation implies correlation" (or more accurately, "causation implies correlation, but not necessarily linear correlation."). And of course, causation implies high mutual information, but high mutual information does not imply causation :) https://stats.stackexchange.com/questions/26300/does-causation-imply-correlation https://stats.stackexchange.com/questions/26300/does-causati...
- mjburgess 2y ago> ,association''[2] always occurs when there is causation This is incorrect. See Perl's work itself. Association does not occur when there is a collider. https://en.wikipedia.org/wiki/Collider_(statistics) https://en.wikipedia.org/wiki/Collider_(statistics) Since almost all variables we are measuring are on uncontrolled environments, in almost all cases, there is an opportunity to observe no association with causation. I give an example of this above: > Consider another medicine which kills everything with kidneys, unless they have a liver (eg., which filters it). Now there is no correlation at all with an effect on the kidneys, nor will there ever be (since all animals with one have the other) unless someone deliberately impairs a liver.
- godelski 2y agoI think our disagreement is coming down to the interpretation and nuance of your example. Mutual information between random variables is zero iff the two random variables are independent. In your example, you illustrate that the MI is non-zero. Sure, it is clear that it may appear zero during sampling, but that's a different story. I fully agree that there is an opportunity to observe no association. That is unambiguously accurate. But in this scenario you presumably haven't sampled animals with damaged livers. But you can also have bad luck or improper sampling even when the likelihood of sampling is much higher! That doesn't mean that there is no association, that means there's no measured (or observed) association. The difference matters, black swans or not. Especially being experimentalists/analysts, it is critical we remember how our data and experimentation is a proxy, and of what. That they too are models. These things are fucking hard, but it's also okay if we make mistakes and I'd say the experiments are still useful even if they never capture that relationship. If we strengthen your example to the medicine always being (perfectly) filtered out by a liver (even an impaired one) and all animals must have livers, then it does not make your case either. We will be able to prune that from the DAG. The reason being that it does not describe a random variable... (lack of distribution). I think you're right to say that there is still a causal effect, but what's really needed is to extend the distribution we are sampling from to non-animals or at least complete ones. But the point here would be that our models (experiments) are not always sufficient to capture association, not that the association does not exist. Maybe you are talking from a more philosophical perspective? (I suspect) If we're going down that route, I think it is worth actually opening the can of worms: that there are many causal diagrams that can adequately and/or equally explain data. I don't think we should shy away from this fact (nor the model, which is a subset of this), especially if we're aiming for accuracy. I rather think what we need to do is embrace the chaos and fuzziness of it all. To remember that it is not about obtaining answers, but finding out how to be less wrong. You can defuzz, but you can't remove all fuzz. We need to remember the unfortunate truth of science, that there is an imbalance in the effort of proofs. That proving something is true is extremely difficult if not impossible, but that it is far easier to prove something is not true (a single counter example!). But this does not mean we can't build evidence that is sufficient to fill the gaps (why I referenced [0]) and operate as if it is truth. I gripe because the details matter. Not to discourage or say it is worthless, but so we remember what rocks are left unturned. Eventually we will have to come back, so its far better to keep that record. I'm a firm believer in allowing for heavy criticism without rejection/dismissal, as it is required to be consistent with the aforementioned. If perfection cannot exist, it is also wrong to reject for lack of perfection.