4 ms·
In a nutshell: If the p-value is below some conventional threshold (in psychology it's usually 0.05), you can conclude that the null-hypothesis (no effect) is l
by tmalsburg2 9y ago
In a nutshell: If the p-value is below some conventional threshold (in psychology it's usually 0.05), you can conclude that the null-hypothesis (no effect) is likely wrong and that something else must be the case. However, if p is above the threshold you can't conclude anything, because that means that there is either no effect or that the data was not sufficient to show the effect. So the p-value method (formally known as null-hypothesis significance testing, NHST) can only ever be used to reject the null hypothesis but not to support it. This is where Bayes factors are different. In that approach, you formulate not just one hypothesis but two. Then you test how well both hypotheses are supported by the data. Three conclusions are possible: Hypothesis A receives more support, the alternative hypothesis receives more support, there is not enough evidence to conclude anything with sufficient certainty. Presented this way, the Bayes factor approach appears to be strictly superior to NHST. But there are also some complications that make Bayes factors tricky (related to how you select and formulate the hypotheses) and some statisticians go as far as to say that Bayes factors are obviously non-sense (e.g. Andrew Gelman). The truth is probably that they are neither a panacea nor non-sense.
- nurettin 9y agoThat makes a lot of sense, but can't you model two null hypotheses using the same data in some clever way?