3 ms·
>>>• Replication studies don't solve many of the most common types of scientific fraud. Instead, you just end up replicating the fraud itself. This is usually b
by gadders 2y ago
>>>• Replication studies don't solve many of the most common types of scientific fraud. Instead, you just end up replicating the fraud itself. This is usually because the methodology is bad, but if you try to fix the methodology to be scientific the original authors just claim you didn't do a genuine replication.
>>>• Many papers can't be replicated by design because the methodology either isn't actually described at all, or doesn't follow logically from the hypothesis. Any attempt would immediately fail after the first five minutes of reading the paper because you wouldn't know what to do. It's not clear what happens to the money if someone gets funded to replicate such a paper. Today it's not a problem because replicators choose which papers to replicate themselves, it's not a systematic requirement.
Isn't this what peer review is for?
- mike_hearn 2y agoYes but it only works if the field has consistently high standards and the team violating them is an outlier. In a surprisingly large number of cases replications are hard/impossible because the entire field has adopted non-replicable techniques.