4 ms·
Let's be clear on the differencen between reproducible and replication. Reproducible is when an experiment's data and methods are published and other researcher
by geomark 11y ago
Let's be clear on the differencen between reproducible and replication. Reproducible is when an experiment's data and methods are published and other researchers can reproduce the same statistical results. An experiment that has been replicated is a new experiment that applies the same methods to a new set of subjects and arrives at statistically equivalent results.
The distinction is important. Reproducible research is a lot easier but there are still famous examples of attempts to reproduce published results that revealed serious flaws. Cases where the data are kept secret to thwart reproducibility are thoroughly suspect. Replication is a harder problem, both in being able to perform a potentially costly and difficult experiment, and in the statistical analysis to show equivalent results.
- nonbel 11y ago>"Let's be clear on the difference between reproducible and replication." I did not find this clear. What is the distinction you are trying to make?
- geomark 11y agoReproduce: take the published data and methods, rerun the analysis, see if you get the same results. No new experiment. Replicate: perform a new experiment with new subjects, apply the same methods, see if you get statistically equivalent results.
- nonbel 11y agoThanks, I had not heard that distinction in terms before. I suppose it would be good to have, but I would not assume people are using them in that way.
- geomark 11y agoSome people are making a lot of noise about making the distinction, like the guys teaching data science at John Hopkins. It's because both are important but they are distinctly different activities.
- sanoli 11y ago'Replicate' is clear to me. 'Reproduce', in this context, still isn't. Could you give an example?