6 ms·
You issue is with people upvoting things into HN frontpage, not with N. There are multiple reasons why small N is not bad thing. Firstly, multi year research
by nabla9 7y ago
You issue is with people upvoting things into HN frontpage, not with N.
There are multiple reasons why small N is not bad thing.
Firstly, multi year research projects are not silent for years or decades before they deliver final paper. They publish interim research, technical reports, exploratory research or preliminary research to clarify issues and fine tune the direction of research. You do something and you publish it.
Secondly, multiple studies where N is small can be more reliable than one big study with large N. There are errors other than statistical errors.
Thirdly. Effect size is much more important than N. N=1 can win you a Nobel price if the effect size is big enough. Grow a mice that weights 10 kg and N being 1 or very small number is good enough. There are many studies where N is tens of thousands (p < 0.001) but the effect size is so small that the result is not scientifically interesting.
Finally, statistics is not the final arbiter of importance of the study. It has become standard to add it into every publication, no matter how small. But researchers don't focus on that.
---
Everyone wants to participate in the discussion and most people in comment sections know something about statistics but little to nothing about the subject, so you always get the 'correlation is not causation', 'small N' so it's irrelevant talking points.