3 ms·
It's not just the publishing process that's broken. The funding process is problematic as well. Among the competitors for grant money, it is the investigators
by blahblahblah 16y ago
It's not just the publishing process that's broken. The funding process is problematic as well. Among the competitors for grant money, it is the investigators that promise to do a lot with the minimal amount of funding that can reasonably be believed to be feasible for the project who end up winning the grant money. This optimizes the funding process to select for proposals that aim to collect the bare minimum of data that the statistician says is required to see a "significant" result (because data collection is the expensive part of doing a study). If the investigator's estimate of the effect size is off, then the sample size is insufficient and spurious results are more likely. Change the funding process to select for proposals that involve collecting a sample size that is larger than strictly necessary for the expected effect size by some margin of safety and you'll get research results that are more likely to actually be true.
- forensic 16y agoThe people commissioning these studies need to somehow be liable for the accuracy of the results. If you were doing a private study where the results would only be for your own private usage, you would go the extra mile and pay the extra money for good, accurate science. But the financiers here don't really care about whether the result is accurate. They usually are optimizing something else entirely and accuracy is just some minimum threshold to avoid being accused of fraud.
- krakensden 16y agoLiable seems too strong- there are lots of ways for studies to go wrong, that you may not figure out for years, through no particular malice or lack of competence.