4 ms·
The facts are spread throughout the article, so this might help: * Prior replication studies replicated 39% of papers in psychology journals [Ed note: That doe
by forapurpose 8y ago
The facts are spread throughout the article, so this might help:
* Prior replication studies replicated 39% of papers in psychology journals [Ed note: That doesn't mean the other 61% were complete failures; most just didn't produce results as statistically strong as the originals IIRC] and 61% in economics journals.
* This replication study greatly increased the number of participants in some experiments, and for two papers, that changed the replication results from failure to success. Overall 62% of the studies were replicated successfully.
* One researcher "points out that the project repeated only one experiment from each paper, and in his case, it wasn’t the strongest or the most important."
- TangoTrotFox 8y agoYou're missing arguably the single most important sentence in this article: * If an initial replication attempt failed, the researchers added even more participants.
- bencollier49 8y agoWhich is not unlike doubling-up at blackjack, which will get you thrown out of a casino. Start with 25 participants, then if you don't get the result you want, add 50 and try again. Carry on doubling until you get the result you want. Not a statistician here, but as each addition is essentially a new trial, shouldn't they have applied Bonferroni correction to the results?