2 ms·
This is about more than mere p-values. This is a fundamental problem of tools themselves. Using a programming language, hammer, or stats tool incorrectly courts
by navait 12y ago
This is about more than mere p-values. This is a fundamental problem of tools themselves. Using a programming language, hammer, or stats tool incorrectly courts disaster.
But some tools are better than others about teaching people how to use themselves correctly. Math tools like the p-value are really hard, because most scientists are not math people - they want a quick solution, whereas statistics requires deep understanding. P-values are just so appealing as a magic number. An apt anology is the late 90's PHP people who just wanted a solution now, rather than designing a robust application for the future. The question then becomes:
1) How can build tools that lead people toward the correct decision, or at least avoid the unambiguously wrong ones.
2) If we can't do 1, we need to spend more time educating users, and figuring out why they make the wrong decisions regarding a tool.
Unfortunately, I can't say these are easy, or even possible problems to solve. We just do the best we can.