3 ms·
You're not wrong, but the important point is that people using p-value tests don't really understand what they mean (what practical conclusions should be drawn
by jrochkind1 7y ago
You're not wrong, but the important point is that people using p-value tests don't really understand what they mean (what practical conclusions should be drawn from results), even when they do do the math correctly; and people consuming them really don't understand what they mean, or even how to know if the math was done correctly.
They mean a lot less than people assume, and in some cases, as you suggest, something different than they assume. (Ie, "statistical significance" relates to confidence that the results showed a reproducible correlation (and are never 100% 'proof' of this, just a level of confidence; and are totally ruined if you've been doing data dreding/p-hacking), rather than any kind of magnitude of effect).