3 ms·
>If you run 1000 experiments over the course of your career, and you get a significant effect (p < .05) in 95 of those experiments I'm all for criticism of p-v
by BeetleB 7y ago
>If you run 1000 experiments over the course of your career, and you get a significant effect (p < .05) in 95 of those experiments
I'm all for criticism of p-values, but when I read a lot of critiques, I get to this point and simply stop reading.
No statistics text book that I've read assigns the magic value of p=0.05 and labels it as significant. All the ones I've read tell you to pick a p-value appropriate to your experiment. Yes, I get it that many social scientists don't have much of a clue and use 0.05 as some special threshold, but let's direct the criticism to the guilty parties, instead of blaming a statistical methodology.
I mean, we all know people who misuse the mean ("the average number of breasts a person has is 1") and ignore the shape of the distribution and the standard deviation. Yet we don't say "Let's stop using the mean!"