4 ms·
How's this paper's reproducibility? Because more and more I see Google publishing papers with internal data and telling others "if you had this data you would b
by msoad 5y ago
How's this paper's reproducibility? Because more and more I see Google publishing papers with internal data and telling others "if you had this data you would be able to reproduce this results"
- phreeza 5y agoIsn't it the same in many cases? E.g. the discovery of the higgs boson is only possible with access to a large particle accelerator, many astronomy studies are only reproducible with access to a large telescope, and some ml studies are only reproducible with access to a large dataset. Sure it's not ideal, but it's better than not publishing the results at all.
- stellaathena 5y agoYes, but that data is made publicly available in physics. It’s not kept as a secret so some company can make millions of dollars selling it.
- phreeza 5y agoI think the fact that there are two things called 'data' here obscures the better analogy. The physics data is made available publicly, but you can't reproduce the method of generating it without building a particle accelerator. Similarly, trained models are often made public, but the dataset used to generate it isn't. So perhaps the data in physics is more analogous to the trained model.