3 ms·

Slide 12 onwards illustrates my regarding hypothesis testing in the sciences: https://indico.cern.ch/event/995950/attachments/2171998/3676039/slides.pdf https:/

Slide 12 onwards illustrates my regarding hypothesis testing in the sciences: https://indico.cern.ch/event/995950/attachments/2171998/3676039/slides.pdf https://indico.cern.ch/event/995950/attachments/2171998/3676... Say you have a dataset with several variables and you’re looking for correlations between them. If 20 different groups separately download the dataset and test hypotheses, should their p-values be adjusted for multiple hypothesis testing?

rscho 5y ago
Ok, now it's clear. So yes I agree that controlling false discovery rate is an unsolved problem that p-value doesn't address. Yes of course applied stats are a kind of 'soft science', at least regarding the interpretation of results. Statistical theory on the other hand, is very well defined. So that doesn't justify considering assumptions made from erroneous conceptual understanding. This is where we disagree, I guess.