This is a really interesting idea. Adversarial collaboration has produced some interesting results, and is probably our best bet for settling arguments on topi

This is a really interesting idea. Adversarial collaboration has produced some interesting results, and is probably our best bet for settling arguments on topics where results are consistently rejected over methodology. It's done good work on ESP, and shows some promise on priming if anyone will actually sign on. But that basically requires finding fields with conflicting viewpoints and well-understood methodology spats, which means established debates. This idea would get the same effects - experiment design that's accessible and verifiable - on untested topics, while simultaneously baking replication attempts into initial publication. The more I think about this, the more impressed I am. It guarantees replications, it guarantees data and methodology availability, and it makes replications a publication-worthy step by making them part of the initial 'success'. It doesn't solve the file drawer or salami slicing problems, but it does huge work to sidestep them by forcing another p<.05 which isn't subject to them. And wildest of all, it might even be acceptable to journals in a way that "publish replications and null results" isn't. Thanks for the most creative approach to the replication crisis I've heard in ages!