4 ms·
It does mean that the particular causal link in question is marginally more likely than if the correlation had not been observed. Not enough to base action on,
by dllthomas 13y ago
It does mean that the particular causal link in question is marginally more likely than if the correlation had not been observed. Not enough to base action on, though.
It certainly implies (how strongly depends on the actual data) that there is some causal link (A -> B, B -> A, or A <- C -> B), because something is reducing the entropy between the two systems. That again, though, doesn't really tell us enough to be useful.
- Retric 13y agoIt can be a lot more complex than that. Suppose healthy people live longer and are more attractive and Attractive people are more likely to be married. So A <- D <- C -> B. Sometimes A between .5 and .8 -> B but A less than .5 or more than .8 -> !B. So now you can have study's that show more A -> B and others that less A -> B. (Think nutrition)
- dllthomas 13y agoMy arrows weren't meant to be direct causal links. It's still true that there are potential situations I didn't touch (A <- B and B -> A, &c), but those can be reduced to multiple instances of the above. Edited to add: "Sometimes A between .5 and .8 -> B but A less than .5 or more than .8 -> !B. So now you can have study's that show more A -> B and others that less A -> B. (Think nutrition)" My arrows also weren't meant to be implication, just a causal relationship. A -> B and !A -> B would be the same thing. I should probably have been more explicit about all these points.
- lutusp 13y ago> My arrows also weren't meant to be implication, just a causal relationship. But in the typical case of a measured correlation, no causal relationship can be implied based on the data alone, regardless of the direction. This is especially true in examples of data mining, where many correlations are located that arise purely from chance rather than design.
- dllthomas 13y agoNo particular causal relationship, right. Existence of a causal relationship can be.
- Retric 13y agoHe is referring to the issue where data-mining creates a lot of meaningless correlations. http://xkcd.com/882/ http://xkcd.com/882/ aka many correlations are located that arise purely from chance rather than design A single study is generally close to worthless.
- dllthomas 13y agoYes, the correlation has to be sufficiently unlikely to have arisen by chance. Even in that case, though, our estimate of green jellybeans having some causal relationship with acne should increase.
- lutusp 13y ago> It does mean that the particular causal link in question is marginally more likely than if the correlation had not been observed. Not really -- it fails to consider the possibility that B caused A rather than the reverse, or that an unevaluated cause C caused both A and B. This is why I hate hearing the common phrase, "In a recent study, (something) has been linked to (something)". The words aren't false, but they're misleading to an untrained person. > That again, though, doesn't really tell us enough to be useful. That's certainly true.
- dllthomas 13y ago"Not really -- it fails to consider the possibility that B caused A rather than the reverse, or that an unevaluated cause C caused both A and B." Yes really! Just because things are uncertain doesn't mean they're equally uncertain as you learn new facts! "A causes B" doesn't become more likely relative to "B causes A" when you learn there is a correlation, but both become more likely relative to "there is no causal relationship between A and B whatsoever" and thus more likely overall. Probabilities sum to 100%. We learned that one possibility is less likely - that probability has to go somewhere.
- lutusp 13y ago> Just because things are uncertain doesn't mean they're equally uncertain as you learn new facts! But that's the foundation on which science is built -- the null hypothesis -- the default precept that a correlation has no meaning without evidence supporting one. The idea that unexplained correlations are assumed to arise from chance, not an uncovered cause. Until there's evidence that cannot be explained any other way, two apparently connected things are presumed to be connected by chance. > ... but both become more likely relative to "there is no causal relationship between A and B whatsoever" You're starting out making an assumption that has no basis. In science, the default assumption about a correlation is that it has no meaning whatsoever. > Probabilities sum to 100%. Yes, they do, but the initial probability is 100% that the correlation arises from chance. This is why the scientists at the LHC refused to speculate about the existence of the Higgs until they had acquired a p factor of 5σ. Details: http://blogs.scientificamerican.com/observations/2012/07/17/five-sigmawhats-that/ http://blogs.scientificamerican.com/observations/2012/07/17/... "Scientists use p-values to test the likelihood of hypotheses. In an experiment comparing some phenomenon A to phenomenon B, researchers construct two hypotheses: that “A and B are not correlated,” which is known as the null hypothesis, and that “A and B are correlated,” which is known as the research hypothesis." "The researchers then assume the null hypothesis (because it’s the most conservative supposition, intellectually) and calculate the probability of obtaining data as extreme or more extreme than what they observed, given that there is no relationship between A and B. This calculation, which yields the p-value, can be based on any of several different statistical tests. If the p-value is low, for example 0.01, this means that there is only a small chance (one percent for p=0.01) that the data would have been observed by chance without the correlation. Usually there is a pre-established threshold in a field of study for rejecting the null hypothesis and claiming that A and B are correlated. Values of p=0.05 and p=0.01 are very common in many scientific disciplines."
- pavelrub 13y agoIt means nothing. Causation can exist without correlation.
- dllthomas 13y ago"Causation can exist without correlation." True, but I'm pretty sure I didn't rely on an assumption that it couldn't. Too much correlation without any thing causing that correlation is unlikely. How unlikely depends on just how much correlation. When something is way more unlikely given X than Y, that is evidence for X over Y.
- pavelrub 13y agoNo. Correlation doesn't make causation more likely. This is something you have made up.
- dllthomas 13y agoIt's not something I've made up. It is a simple combination of Bayes' Theorem and thermodynamics. A strong correlation is a lower entropy system. The stronger the correlation, the more likely it is that there is some explanation for that correlation, even if we haven't found it yet.
- pavelrub 13y agoThis is hand waving based on dubious analogies. You keep repeating the same thing without providing any justification, proof or sense behind it, despite being given counterexamples and counterarguments. Please show me a mathematical derivation of this "simple" result, based on whatever statistical model you would like. We are not talking about the likelihood of an "explanation", we are talking about the likelihood of x causing y.
- snowwrestler 13y agoOnly if you are testing a specific hypothesis. If you simply observe an apparent correlation for the first time, a causal relationship is no more likely than before your observation. It's simply the basis for forming a hypothesis, which is the first step needed to even look for causation. Most hypotheses do not pass testing. This implies that most observed correlations turn out to not be causal.
- dllthomas 13y ago"Most observed correlations turn out not to be causal" is perfectly well consistent with "causation is more likely having observed a correlation than having failed to observe a correlation, or even not yet having observed".
- snowwrestler 13y agoIf you look for a specific correlation and fail to find it, yes. If you simply observe an unexpected correlation for the first time, no. You have no idea if it unique, remarkable, repeatable, etc.