4 ms·
> You mean that papers are published with P<0.05? I'm guessing you meant to say that no papers are published with P<0.05. And of course they are, but that's i
by lisper 9y ago
> You mean that papers are published with P<0.05?
I'm guessing you meant to say that no papers are published with P<0.05. And of course they are, but that's irrelevant. What matters it that many journals, especially in "softer" sciences (i.e. not physics) use p<0.05 as their threshold, which guarantees that at least one paper in 20 will be "wrong". Then add self-suppression of negative results and the actual percentage of "wrong" papers becomes higher, potentially much higher if real positive results are rare.
> When did this become a "standard"?
I have no idea. You'll have a ask a historian.
- hpcjoe 9y agoPart of the mistake here is in interpreting the p value as being a measure of anything really meaningful. P<0.05 doesn't mean 1 in 20 are wrong. It does mean that in the narrow confines of the definition of the statistical model used, it is possible that 1 in 20 would be explainable by the null hypothesis. It is not, in any way a measure of reality. It is a guess at how accurately you've modeled the system, how accurate your priors are, and so forth.
- lisper 9y ago> P<0.05 doesn't mean 1 in 20 are wrong > It does mean that ... 1 in 20 would be explainable by the null hypothesis. That seems like splitting a pretty fine hair to me, particularly since I haven't actually committed to any of the many possible interpretations of the word "wrong".