5 ms·

A growing number of people seem to agree with this ([0],[1]). There are a couple of places ([2],[3]) where one can preregister a hypothesis and experiment befor

A growing number of people seem to agree with this ([0],[1]). There are a couple of places ([2],[3]) where one can preregister a hypothesis and experiment before collecting data. There are also some journals that are starting to encourage preregistration ([4],[5]). It would be nice if this phenomenon spread beyond the few fields it's started in. I don't know about needing to see all the intermediate data, that seems extreme if the methodology is properly described and the raw data is available. 0: https://www.bitss.org/2014/06/13/preregistration-controversy/ https://www.bitss.org/2014/06/13/preregistration-controversy... 1: https://www.apa.org/science/about/psa/2015/08/pre-registration.aspx https://www.apa.org/science/about/psa/2015/08/pre-registrati... 2: https://aspredicted.org/ https://aspredicted.org/ 3: https://osf.io/ https://osf.io/ 4: https://www.psychologicalscience.org/publications/psychological_science/preregistration https://www.psychologicalscience.org/publications/psychologi... 5: https://www.journals.elsevier.com/cortex/news/registered-reports-a-new-article-format-from-cortex/ https://www.journals.elsevier.com/cortex/news/registered-rep...

radarsat1 8y ago
> preregister a hypothesis and experiment before collecting data This reminds me of an old website, I think it was called Half Baked, where people could (I think anonymously) post just any ridiculous idea for an invention. It was fun to read. Unfortunately I can't find a link. But man, when I think about it in terms of science and in the more modern context of preprints, it sounds like Flag Planting, Extreme Edition. Even the ML community, who encourage preprint publication more than any other field I know of, have had some pretty heated exchanges about the validity of using that medium for flag planting, and that is when the "flag planting" at least consists of a short paper properly describing an idea, with some rudimentary empirical result and analysis. So I dunno, it's an intriguing idea, but not without controversy I think.

radarsat1 8y ago

> preregister a hypothesis and experiment before collecting data This reminds me of an old website, I think it was called Half Baked, where people could (I think anonymously) post just any ridiculous idea for an invention. It was fun to read. Unfortunately I can't find a link. But man, when I think about it in terms of science and in the more modern context of preprints, it sounds like Flag Planting, Extreme Edition. Even the ML community, who encourage preprint publication more than any other field I know of, have had some pretty heated exchanges about the validity of using that medium for flag planting, and that is when the "flag planting" at least consists of a short paper properly describing an idea, with some rudimentary empirical result and analysis. So I dunno, it's an intriguing idea, but not without controversy I think.