4 ms·
Given that publishing an article costs money publishing an attempted replication is not likely to happen - if it succeeds it won't happen because we basically a
by bryanrasmussen 7y ago
Given that publishing an article costs money publishing an attempted replication is not likely to happen - if it succeeds it won't happen because we basically already gave you the information, and if it fails it probably won't happen because so what - a replication failed, should they publish it, what if someone comes along and says no we succeeded in our replication should that be published as well because someone else had a replication fail?
How much of the journal should be given over to replications that fail, and then the replications that succeed where another failed, and any potential back and forth?
At any rate a replication study while important for the process of science is not so important for the process of news and as Science is a business and using their resources for publishing replications does not seem likely to increase their profit (but maybe even reduce it) while increasing their cost, I am surprised anyone would even think it should or would happen.
Perhaps what there should be is a reproducibility column, where studies attempting to replicate previously published studies are noted. A paragraph summation could be given. As reproducibility of a finding becomes accepted further replications would be dropped from the column as redundant.
on edit: grammar fix.
- kerkeslager 7y agoIf you don't publish replications and failures to replicate, you aren't publishing science. If a study is worth publishing once, it's worth publishing enough times to establish its result as conclusive. Otherwise, you haven't discovered anything, and the whole scientific process has failed, since the purpose of the scientific process is to discover conclusions. You're right that in business, there's a disincentive to publish replications, because business treats science publication as literary nonfiction: they're trying to publish the most sensational results, because the most sensational results sell journals. This is one of the strongest arguments that scientific publication shouldn't be a business: making scientific publication a business creates incentives for scientific publications to not publish science.
- bryanrasmussen 7y agothat's all very well and good, please show how the needs of science to publish all these studies will correspond with the needs of Science to make money to continue publishing studies. My assumption is that the need to make money will beat the need to publish replications. on edit: because it seems like your argument really is that Science the business should shut down.
- kerkeslager 7y agoI don't care about the needs of Science the business. Science the business should shut down, not of their own volition, but because the scientific community shifts away from for-profit publications and Science has the respectability of a tabloid.
- bryanrasmussen 7y agoGreat, that's an honest response - an honest argument to be made. A dishonest response is saying they should publish things that makes no business sense for them to publish, and the logistics of which really makes no sense for their business model, with the seeming purpose of upbraiding them when they fail to do this thing they would never do.
- kerkeslager 7y agoYou're basically saying that Science (the business) should do whatever makes the most money, always, and anyone who criticizes them for doing that is "dishonest". Science (the business) is being dishonest by pretending to publish science (the method for obtaining facts). It's not okay just because it makes them money, and it's not dishonest to upbraid them for their harmful behavior.