2 ms·
I agree with TFA that p-hacking is a bigger problem. Low p-value <=> null hypothesis is unlikely. Choose a shitty null hypothesis ("aliens did it!", "everythi
by jjoonathan 11y ago
I agree with TFA that p-hacking is a bigger problem.
Low p-value <=> null hypothesis is unlikely.
Choose a shitty null hypothesis ("aliens did it!", "everything is Gaussian", etc) and you trivially get low p. Peer review checks this to some extent (you won't get away with "aliens did it") but there's a large gray area of null hypotheses shitty enough to give low p but not shitty enough to be rejected by peer review. Choosing the hypothesis after-the-fact is the most common strategy because it's undetectable except by repeating the experiment, which is hard.