3 ms·
To me this is why the emphasis on “reproducibility” is misguided. You might end up failing because you lack the technical capability. Conversely, you might “suc
by shusaku 4y ago
To me this is why the emphasis on “reproducibility” is misguided. You might end up failing because you lack the technical capability. Conversely, you might “succeed” by making a mistake. We should be focusing on coming up with new ways to test the same hypothesis.
- vlovich123 4y agoThe null hypothesis tells us that if we can reproduce repeatedly and reliably then we can actually use even relatively small number of reproductions to raise the net significance of the result (which also diminishes the ability for fraud to work as it requires a larger conspiracy instead of people just accepting people at their word). If you think reproductions have failed then it’s on you to try to have a cogent explanation for why if you’re personally motivated by a belief that the experiment is actually valid. The particle physics folks also have a different approach these days where they blind the ability to see results and do multiple cross checks of each other’s results to validate the data (because the underlying experiment is so expensive to run). That can also work in theory although hard to say what the success rate of that approach is just yet.
- ImPostingOnHN 4y agothat is what multiple reproductions are for indeed, the initial experiment is not immune to such concerns, and might itself have succeeded by making a mistake or failed because it lacked the technical capability