3 ms·
The article claimed that the (original) article's conclusions about strenuous running were suspect because they were based on 2 deaths out of a sample of 40. B
by swatow 12y ago
The article claimed that the (original) article's conclusions about strenuous running were suspect because they were based on 2 deaths out of a sample of 40.
But is that really the case? I get sick of hearing that "the sample size was too small" when no analysis is done of the statistical significance of the results. In this case, the difference between death rates for strenuous vs moderate runners was significant (by my calculation based on their 95% intervals).
Given the small sample size, there are still questions to be asked about the methods they used to correct for age, sex, etc. But still, outright dismissal based on small sample size is not reasonable. If the sample is big enough to give statistically significant results, that should be an a priori reason to accept the results.
- peteypao 12y ago"But still, outright dismissal based on small sample size is not reasonable." The burden of proof, in my mind, is the one making the claim.
- swatow 12y agoAs I said, statistical significance is a prima facie argument for the claim. If someone wants to dispute it, they need to show why the alleged statistical significance does not support the claim. The statistical significance trumps the sample size, unless someone can show otherwise.