3 ms·
I'd also love to see a journal that agreed to publish work before any results are known. Researchers would submit hypotheses and methodology for review, and the
by austinl 6y ago
I'd also love to see a journal that agreed to publish work before any results are known. Researchers would submit hypotheses and methodology for review, and the journal would publish the results after the experiments were conducted, regardless of their outcome.
It would still incentivize interesting hypotheses, but wouldn't lead to results-biased publications.
- bonoboTP 6y agoYou'd do the work, then sign up, wait a bit (while working on your next project) then you submit the results. This is what happens with many grants anyway. You propose to research the stuff that you already understand, you get funded and can finally work on new stuff you don't understand well enough to get funded for.
- laGrenouille 6y agoThis is a great idea and already being done (somewhat) in some of fields of psychology through pre-registration [0, 1, 2] [0] https://en.wikipedia.org/wiki/Preregistration https://en.wikipedia.org/wiki/Preregistration [1] https://www.psychologicalscience.org/publications/psychological_science/preregistration https://www.psychologicalscience.org/publications/psychologi... [2] https://www.psychologicalscience.org/observer/preregistration-becoming-the-norm-in-psychological-science https://www.psychologicalscience.org/observer/preregistratio...
- occamschainsaw 6y agoThere is a workshop[1] at NeurIPS this year (2020) for experimenting with this model. I hope it is adopted more widely, especially in the ML community to disincentivize the +1-2% performance increase in SOTA papers. [1] https://nips.cc/Conferences/2020/Schedule?showEvent=16158 https://nips.cc/Conferences/2020/Schedule?showEvent=16158