6 ms·
I've got a simpler solution - scientific paper should not be considered valid until another team replicates the findings. That would quickly get rid of all of t
by mariusz79 10y ago
I've got a simpler solution - scientific paper should not be considered valid until another team replicates the findings. That would quickly get rid of all of the fake results, plus would weed out all of the research that nobody really cares about. Also require that all data is shared, and that until your results are not verified or replicated by a team from another university/country you don't get any more funds.
- Jabbles 10y agoThat's not going to work for Astronomy, or results of multi-year studies.
- mariusz79 10y agoit will, if you require that the data is shared and can be analyzed by another group. In some cases it will slow down the progress initially, but I think in the long term we would be getting much better results.
- Declanomous 10y agoYou can fabricate data nearly as easily as you can fabricate results. It is easier to detect fabricated results from raw data than it is from the final results, but fraud adapts to the methods used to detect it. If you create a new way to detect fraud, fraud will change to avoid that method. Detecting fraud is an arms race.
- apathy 10y agoAt some point it becomes easier to just run the damned experiment. Similar to buying a safe based on making its contents not worth the trouble to crack it. This would be a good first step. "Photoshop for biologists" (as a workshop) is very much a thing.
- yayday 10y agoYou're already moving your goalposts. Your first post said replicates the finding. If I simply post my results and someone else looks at the data and agrees with me then are they really replicating my finding or did they, oh what's the word… peer review my work and agreed?
- Fomite 10y agoI really dislike the idea that "Your code runs on your data" is a form of replication.
- apathy 10y agoIt's a minimum standard and one that many published works cannot meet. Universal enforcement of this minimum would itself be a big step forward.
- Fomite 10y agoIt is a minimum standard, and a useful one. It mostly annoys me when certain groups of advocates seem to treat it as an end in and of itself, and evidence that something is "repeatable" and will end the problems in obtaining scientific evidence. I come from a field where something isn't a reproduced until it's also found in an entirely different study on a different population.
- apathy 10y agoOh, same here. Two of my current manuscripts have now been replicated in 3-5 independent clinical cohorts. The thing is, if the field won't even recognize that "ability to produce the same outputs given your inputs" is critical, good fucking luck with things like "actually replicates in a separate population". Neuroscience is particularly horrendous about this.
- deleted 10y ago[deleted]
- djokkataja 10y agoLong-term studies or not, it would be useful to have an up-to-date system that clearly indicated whether or not the results of some particular study had been replicated, and how many times they had been replicated if at all, and if there were any conflicting results between studies.
- apathy 10y agoThat is what Cochrane does in the UK. And indeed it is great.
- Fomite 10y agoWhat will you do for a study of a national birth cohort?
- alphydan 10y agoClone them?