6 ms·
Interesting. The fundamental question is: do journals have an ethical obligation to publish credible results which refute previously published results in the jo
by crazygringo 7y ago
Interesting. The fundamental question is: do journals have an ethical obligation to publish credible results which refute previously published results in the journal?
The authors argue yes. I'm not sure myself -- what is a refutation vs. a different perspective/interpretation or other addition and where do you draw a line?
But it's intriguing to think if this would be a meaningful force for better results -- and could be an incentive to replicate findings you think might not hold up, just from being in a prestigious journal.
- CDRdude 7y agoThe authors are arguing that it should at least be sent out for review—not necessarily published.
- zmmmmm 7y agoI found that weird. Sending something out to review that would definitely not get published regardless of the review is a complete waste of time for the journal and the reviewers. I would find it insulting as a reviewer to be asked to do that.
- vinay_ys 7y agoWhy would it definitely not get published? I found their request totally reasonable. They have followed the scientific process well. Even the journal's editorial team acknowledged that. Then they have an obligation to at least facilitate peer-review. Especially since it will further the science on a subject they have already published. It is important that we call on such publications and demand an explanation. If you or your organization is a paying subscriber, then demand to know their policy on this matter and let them know what you think. Otherwise they have no accountability.
- zmmmmm 7y ago> Why would it definitely not get published Because the journal already made that decision, and that is their right. > Then they have an obligation to at least facilitate peer-review Reviewers work for free and are an extremely scarce commodity. Review of a work like this is effectively expending tens of thousands of dollars of people's time. It isn't something we can just indulge in for the fun of it. Besides that, you might not appreciate exactly how much chaos would break out and how much it would undermine the academic publishing system if any paper rejected had to be reviewed just because the submitter demanded it. The system simply wouldn't work at all. There are a lot of journals in the world and if the author's work is good, they should be able to get a different journal to publish it.
- ISL 7y agoI would argue yes. If the answer to a question is sufficient to warrant publication, any significant revision/contradiction to a published result obviously warrants publication. Further follow-ups need not be published in the same journal, but the first correct/convincing refutation of a published article definitely should be.
- Misdicorl 7y agoNo. This belongs in a journal dedicated to the field of study, not a general issue journal like Science. The authors are silly to think otherwise. It is also not surprising that Science published a flashy article without a lot of oomph behind it. It's what they do.
- pdonis 7y agoSo a journal can get a free pass on an obvious violation of scientific ethics just by saying that they're a general issue journal? The field of study has nothing to do with it. If a journal publishes a result, they are ethically obligated to publish further work that refutes that result.
- dash2 7y ago“If a journal publishes a result, they are ethically obligated to publish further work that refutes that result.” Too general. Few in science would accept this. The claim here is the weaker one that journals are ethically obliged to accept failed replication studies - and even that is non-obvious to me. (Should Science also be obliged to accept _successful_ replications? No? So it should accept papers on the basis solely of the results? Hello, publication bias.)
- vinay_ys 7y agoAren't they obligated to investigate? If the methodology applied is sound and conclusions are different, isn't that scientific progress in and of itself? The ask here is to send it for peer-review so that they get some different points of view which may guide their own further study. They are ok with rejection but not without peer-review.
- Hasknewbie 7y agoNice attempt at reframing there, but if this new paper is correct then it's not a 'failed replication', it's a refutation. Big difference.
- londons_explore 7y ago
- amelius 7y ago> The fundamental question is: do journals have an ethical obligation to publish credible results which refute previously published results in the journal? The answer is: yes, because that's how science works! And it's especially true if your journal is named "Science".
- TheOtherHobbes 7y agoNot just "Yes" but "There is no case not to." Science works best as a debate and not as a statement of truth from on high. If you only publish "This is true" while excluding "No it's not because..." you're doing missionary work and career enhancement, not science.