3 ms·
I wonder if it's better to have a lot of small hits or a few big hits and many misses in regard to replication. If the studies which have the greatest implicati
by paulpauper 3y ago
I wonder if it's better to have a lot of small hits or a few big hits and many misses in regard to replication. If the studies which have the greatest implications replicate, then maybe many misses is not that bad.
- btilly 3y agoThat's an interesting theoretical question. Unfortunately the reality is that the more interesting and quotable the result is, the less likely it is to replicate. So replication problems most strongly hit things that seem like they should have the greatest implications. Kind of a "worst of all worlds" scenario.
- ethanbond 3y agoAnd critically, scientific publications are incentivized likewise to publish the most outlandish claims they can possibly get away with. That same incentive affects individual scientists, who disproportionately submit the most outlandish claims they can possibly get away with. The boring stuff -- true or not -- is not worth the hassle of putting into a publishable article.
- btilly 3y agoAnd then the most outlandish of these are picked up by popular science writers. Who proceed to mangle it beyond recognition, and add a random spin. This then goes to the general public. Some believe the resulting garbage. And wind up with weird ideas. Others use that garbage to justify throwing out everything that scientists say. And then double down on random conspiracy theories, denialism, and pseudoscience. I wish there was a solution to this. But everyone is actually following their incentives here. :-(