3 ms·
The problem is that if you've compared 10,000 theories to find one that fits, that theory now has to have 10,000x stronger evidence to account for multiple hypo
by CuriouslyC 3y ago
The problem is that if you've compared 10,000 theories to find one that fits, that theory now has to have 10,000x stronger evidence to account for multiple hypothesis testing.
- wcoenen 3y agoOr just test one new prediction made by the selected model, which isn't accounted for by existing physics. Edit: to clarify, I agree that it is important to avoid picking a model which happens to fit noise in existing data, which would be P-hacking. But I think this problem doesn't exist if you pick a model, predict something novel, and then go test that prediction. I could be mistaken.
- light_hue_1 3y agoThere's essentially nothing to test. Even in principle no one can find a way to extract some new physics that's even remotely observable. In any case, string theory already makes predictions, like supersymmetry that have failed every test so far.