2 ms·
“The effect size is too large” is not the heuristic, and casting the argument that way does it a disservice. The article gives concrete examples of effect sizes
by klodolph 8y ago
“The effect size is too large” is not the heuristic, and casting the argument that way does it a disservice. The article gives concrete examples of effect sizes that are impossibly large. Examples of penicillin and insurance payouts are not remotely germane to the discussion… the point of “impossibly large” is that the effect is so large that it would almost certainly have other effects that we would notice. This is the difference between “impossibly large” and “surprisingly large”, which your argument ignores.
The exhortation to look at the mechanism is also critical, and ignoring the mechanism is exactly how you end up with the worst inferences… if something is “impossible” or even just “surprising” according to your model you should probably reëvaluate your model.