3 ms·
Upvoted, but citation needed for "the fabrications are usually discovered." Basically the state of any research that nobody has tried to replicate yet is unknow
by l0b0 8y ago
Upvoted, but citation needed for "the fabrications are usually discovered." Basically the state of any research that nobody has tried to replicate yet is unknown.
- coldtea 8y agoIt's also a logical impossibility to really determine whether "fabrications are usually discovered" or not. We can only know about fabrications after they have been discovered -- so there could be 2x or even 10x as much that we don't know about and count among the "non fabricated" work.
- tlb 8y agoIt's not impossible. We know how many fabrications are discovered. You can take a random sample of papers and analyze them in depth to estimate the number of papers that are fabricated.
- coldtea 8y ago>You can take a random sample of papers and analyze them in depth to estimate the number of papers that are fabricated. That assumes that the fabrications in those papers will be revealed upon further analysis. And, what's worse, that such analysis is economically feasible. Most metastudies don't even verify the original results, just assume them as fine.
- tlb 8y agoThat's makes it merely expensive, not impossible. The Reproducibility Project got a long way on a modest budget. They replicated 100 studies, got similar results on only 35%, for $15M. https://en.wikipedia.org/wiki/Reproducibility_Project https://en.wikipedia.org/wiki/Reproducibility_Project.
- l0b0 8y agoSince you're looking for a (presumably) small signal you need to analyse quite a lot of papers to determine anything. And of course, who can trust a giant analysis study without further analysis?