3 ms·
It's not even talking about biology research, or even most medically related research. While it was a great point to make at the time, far too much has been ma
by epistasis 8y ago
It's not even talking about biology research, or even most medically related research.
While it was a great point to make at the time, far too much has been made of it. Yes, don't p-hack, but it's also better to publish data than to withold it just because there wasn't a positive result. We need better publication mechanisms for data that doesn't have any significant findings.
- astazangasta 8y agoErr, this 100% applies to biology research, where there is absolutely a problem of small sample sizes, small effects, etc. Our studies (my field is cancer) are routinely vastly underpowered because of the high variability of the datasets we are studying, the low availability of samples, and the large number of variables we collect on these sample. Also, to a good approximation, everybody p-hacks. Furthermore, the habit of publishing "noteworthy" results (true in every journal, especially true for large impact factor journals) is essentially p-hacking across the entire field. This is a huge problem.
- epistasis 8y agoHow many of your papers consist of a single statistical test, without validation experiments? Because that's the setup that's described in order for "most published research findings are false." In reality, I've never seen a biology paper without several lab techniques and orthogonal verifications, with p-values on some but not all of those experiments.
- serghiou 8y agoGood point - the problem is that the grand majority of researchers publish only a very small part of what they actually did - this creates a missing data problem and greatly skews perceptions of those reading their work. If everyone published everything they had done, the problem with reproducibility would have been greatly reduced.