3 ms·
>>>> Increase sample sizes and lower the significance threshold to .005. I'm a physical scientist in industry, so I don't publish, or use p-values. But if the
by analog31 4y ago
>>>> Increase sample sizes and lower the significance threshold to .005.
I'm a physical scientist in industry, so I don't publish, or use p-values. But if the familiar "square root of n" rule holds, than a 10x improvement in any kind of "noise" measure requires a 100x increase in sample size. This is probably impossible for many kinds of experiments. Even in my work, desiring such an improvement usually requires me to scrap an experiment and come up with a better one, rather than slogging away to collect more data.
Worse, we may suffer from the fact that for some kinds of studies, sample size is limited by the number of potential subjects per researcher. You can only ask undergraduates to do so much. More researchers in the field means weaker statistics.
A possible minor improvement is to eliminate the requirement of publishing a masters thesis project. My friends who were psych grad students all had to do a master's en route to the PhD, and it had to be published to fulfill their requirement. This might have seemed like a quality check, but instead created an incentive to load the literature with low quality research. And many of the students were not looking forward to research careers anyway. Their term for finishing the degree was "published and outa here."