4 ms·
Why not just be more clear and instead of writing the "p-value < 0.05", write: The probability that the difference between these two groups is by chance is less
by teekert 9y ago
Why not just be more clear and instead of writing the "p-value < 0.05", write: The probability that the difference between these two groups is by chance is less than 5%. Then everybody knows that if you do this a bit more than 20 times this results is achieved by chance alone. Then, just show the damn plots and let me see how much distributions overlap. I have seen insanely small P-values with completely overlapping distributions just because of large amounts of data. I find the P-value near useless.
Personally I much prefer ROC curves, they are much better at showing the difference between distributions. Still, nothing beats the raw data and healthy skepticism.
- FabHK 9y ago> The probability that the difference between these two groups is by chance is less than 5%. That's a common misunderstanding of the p-value, but that's not what it means. (It means: assuming there is no difference, the probability that we'd nevertheless see a difference as big as we are seeing or even bigger is less than 5%).