3 ms·
I'm thinking back to my graduate thesis project, in physics. I started with a fairly nebulous problem, and went down a lot of blind alleys before I finally got
by analog31 9y ago
I'm thinking back to my graduate thesis project, in physics. I started with a fairly nebulous problem, and went down a lot of blind alleys before I finally got something working. And there were some unexpected results that we didn't even have a good way of describing until we saw them happen and puzzled over them. I published a few weeks later, and my advisor moved to another university a few weeks after that.
A rigid rule of pre-registering "study, methodology, and hypothesis" would have prevented me from even launching the project. At the very least, I would have had to register a formal study after my results were already established to a decent degree of confidence. It would have been wasteful and redundant, not to mention risky, since anything can happen to a grad student to prevent them from finishing a degree (illness, loss of faculty advisor, etc). At best, time is money for a grad student who wants to get out of school ASAP and start earning a salary.
My project produced a humble but solid result, and launched a new research program for my advisor, that bore fruit for another 25 years.
Now, I wasn't doing a "study," as in a life science study looking for a statistical correlation. I reported no p-value. So maybe it doesn't apply to all kinds of scientific work. And I appreciate the need to restore come kind of integrity to the medical and behavioral sciences in particular. I don't know how to help those fields, and maybe pre-registration only applies to them. But I'm concerned that declaring rigid rules for science across the board will have unintended consequences.
Edit: Another issue is a student getting "scooped," where some other lab reads the plans and rushes the work to completion. There are labs in chemistry and biology that are notorious for doing this. If a student doesn't at least have an informal guarantee of priority over their own work, they won't take the risk of launching a project in the first place.