3 ms·
I studied physics too, and am not a statistician. My way of interpreting an "absurd" threshold such as 5-sigma, is that you can stop using hypothesis testing,
by analog31 12y ago
I studied physics too, and am not a statistician.
My way of interpreting an "absurd" threshold such as 5-sigma, is that you can stop using hypothesis testing, and start using other tools for interpreting data.
Another interpretation is that we set these huge limits because, deep in our hearts, we aren't really comfortable with hypothesis testing. There's Rutherford's famous quip: If your experiment needs statistics, then you should have done a better experiment.
I think statistics are actually used pretty sparingly and with caution in physics. There are lots of experiments where the presence or absence of a phenomenon is not the primary question. I didn't report a p-value at all in my thesis project.