3 ms·
Does some sort of batched style of research already exist? By batched, I mean a study where n number of teams all agree on a single methodology, and then conduc
by hirvi74 2mo ago
Does some sort of batched style of research already exist? By batched, I mean a study where n number of teams all agree on a single methodology, and then conduct the same experiment simultaneously. Each team could then publish their results independently and the teams could publish one aggregate.
I know meta studies attempt to do this in a way, but they can sometimes have their own problems too.
I cannot recall coming across this style of research in much of what I have read as a hobby, but maybe it is more common in some domains than others? I am not smart, and there is nothing new under the Sun, so surely something like this exists, no?
- Quekid5 2mo agoNot quite what you're asking, but pre-registration does alleviate e.g. p-hacking and such without the need for multiple teams. It doesn't do much for outright fraud, but still...
- mike_hearn 2mo agoOnly if the study matches its pre-registration and someone is checking that. Which it turns out, they often don't. https://www.compare-trials.org/ https://www.compare-trials.org/
- Quekid5 2mo agoThat's a fair point. Ultimately, incentives are all screwy at the moment. Gotta tie some actual prestige/shame to not following up.
- yayamo 2mo agoIt doesn’t seem very popular but that exact thing does seem to exist, here called a ‘Registered Replication Report’: https://www.psychologicalscience.org/publications/replication#ONPR https://www.psychologicalscience.org/publications/replicatio... There are some completed which is cool. I agree that this seems like a great initiative.