3 ms·
"If well known and influential studies only have a 50% reproducibility rate - what about the average study?" Actually, they might be better off. In the related
by jonex 8y ago
"If well known and influential studies only have a 50% reproducibility rate - what about the average study?"
Actually, they might be better off. In the related article* they mention: "Beyond statistical issues, it strikes me that several of the studies that didn’t replicate have another quality in common: newsworthiness."
It could be that many well known works are well known because their finding are counterintuitive, and therefore more interesting. However, this could also imply that the prior probability is lower - hence a p = 0.05 result is more likely to be due to chance than for a study finding something more in line with prior understanding of things.
* https://www.theatlantic.com/science/archive/2018/08/scientists-can-collectively-sense-which-psychology-studies-are-weak/568630/ https://www.theatlantic.com/science/archive/2018/08/scientis...