4 ms·
Or, in the form of a comic strip https://xkcd.com/882/ https://xkcd.com/882/ (I have this in my head when p-hacking comes up)
by groestl 3y ago
Or, in the form of a comic strip https://xkcd.com/882/ https://xkcd.com/882/
(I have this in my head when p-hacking comes up)
- jncfhnb 3y agoA bit. But you can test 20 ideas. This is not so bad. We have tools to scrutinize such results like the false discovery rate and related concepts. The real problem is when you set out to test 20 things, and they don’t work, so you test 20 more things; and then much worse when you only tell us about the analysis that lead to the 1/40 that mattered. The thing about p hacking specifically is changing your analysis until it finds something that looks good. A lot of people don’t understand math and will do this and not understand that they’re gaming it. A lot of people will understand this and do it anyway because academia is soul crushing and they need to publish.