4 ms·
P-values work great when they’re super low, experiments run at a human-scale frequency, and hypotheses are extremely precise in their predictions, e.g. some phy
by travisjungroth 3y ago
P-values work great when they’re super low, experiments run at a human-scale frequency, and hypotheses are extremely precise in their predictions, e.g. some physics.
If you run an experiment a day and get p < 10^-9, your priors, your multiple hypothesis correction, even your interpretation of p-values approximately don’t matter. Running social sciences experiments with p < 0.05 threshold is where things get weird.
- constantcrying 3y agoDid you read the article? >even your interpretation of p-values approximately don’t matter "Small number means good" is not a sufficient working understanding of p-values for doing science.
- travisjungroth 3y agoBut what if it’s really small?
- constantcrying 3y agoIt's completely irrelevant if you don't understand how to interpret it. It is not a number which tells you how correct your hypothesis is. That is literally mindless statistics. Which coincidentally is the name of the article I talked about. Did you read it? (In a social science, if your p-value is 1E-5 or something, the most likely interpretation is that you are doing something very wrong)
- travisjungroth 3y agoI did. My statement was hyperbolic. More directly: P-values are more resilient to misuse at their extremes.
- constantcrying 3y agook