3 ms·
>You would hope that research on medicine, of all subjects, would be published in journals that never make mistakes I wouldn't hope this, and maybe it's pedant
by colechristensen 13y ago
>You would hope that research on medicine, of all subjects, would be published in journals that never make mistakes
I wouldn't hope this, and maybe it's pedantic, but there's an important point to make here. Scientific articles are evidence, not truth, and people (and systems) make mistakes. The hallmark of a robust system is not the absence of error, for it is arrogance to believe you've ever achieved it and foolish to have it as your absolute goal. What is important is setting a reasonable expectation of accuracy, the types of errors committed, the root causes of those errors, and responsible, transparent reactions when errors are made.
A system is much more trustworthy when it has a solid history of errors with reasonable responses than a system which claims or appears to suffer from no error at all.
- chmike 13y agoExactly. Reviewers expected to be experts in a field can only check claims against their own knowledge. Their role should be recognized as limited to that and not to have some monopole on the "real truth". Fear of error could make them overly protective if not paranoid. In my sense, scholar communication means should be open but with mechanism to weed oud obvious crap and mechanism for efficient self correction.
- bzbarsky 13y agoThe thing is, the top journals are also _extremely_ loath to publish retractions. Give http://retractionwatch.com/2013/11/27/at-long-last-disputed-dance-study-retracted-from-nature/ http://retractionwatch.com/2013/11/27/at-long-last-disputed-... if you haven't seen it before and note that this is a case in which one of the paper's coauthors has been pushing for the journal to retract it for years. In cases in which it's other scientists pointing out that the paper is bunk, you get situations more like http://retractionwatch.com/2013/07/04/retraction-of-19-year-old-nature-paper-reveals-hidden-cameras-lab-break-in-evidence-tampering/ http://retractionwatch.com/2013/07/04/retraction-of-19-year-... or http://retractionwatch.com/2013/06/19/why-i-retracted-my-nature-paper-a-guest-post-from-david-vaux-about-correcting-the-scientific-record/ http://retractionwatch.com/2013/06/19/why-i-retracted-my-nat... And as for followup papers that contradict/correct the previous one, none of the journals make it easy to tell they exist or anything. So people keep citing the original erroneous paper. That last link in the previous paragraph puts some numbers to the scope of this problem if you look at it (16 citations for the retraction, 976 citations for the bogus unreproducible paper, 700 of the latter coming _after_ the retraction was published).