3 ms·
Fishing for findings is a problem, but also overly stringent multiple comparison correction requirements. Those who preach Bonferroni should consider a life-lon
by SubiculumCode 9y ago
Fishing for findings is a problem, but also overly stringent multiple comparison correction requirements. Those who preach Bonferroni should consider a life-long proposal.
Let us propose that correction for multiple comparisons be a life long endeavor. At the start of a scientist's career as principle investigator, p<.10 is fine. But by their career's 10th comparison, they have to meet at Bonferroni p<.01, and at their career's 100th comparison, now they have to meet at Bonferroni p<.001. When they are old and gray, or doing genomics, at their 1000th comparison they have to meet at p<0.0001.
- SubiculumCode 9y agoYoung investigators tend to get smaller grants and sample size can be an issue. Relaxed threshold for the beginning of a career helps them, career wise. Older investigators frequently start heading really large, ambitious projects with large sample sizes, but they would have to face more stringent p-values. Interesting dynamic.
- carbocation 9y agoGenomics generally uses 5e-8 (p<0.00000005) as its significance threshold. That aside, your point is clever. How to handle coauthors of different ages is left as an exercise to the reader.
- SubiculumCode 9y agoI figured it as the p-value rate goes with the PI, the funded investigator.