4 ms·
You make it sound like those studies were bad because the sample size was too small. In reality bad study design or having an unrepresentative sample are more c
by mactrey 5y ago
You make it sound like those studies were bad because the sample size was too small. In reality bad study design or having an unrepresentative sample are more common issues.
- danenania 5y agoI think they go hand-in-hand. People naively apply intro-level statistics to messy real-world problems and then think they need an orders of magnitude smaller sample than they would need to even hint at the possibility of an interesting effect.
- majormajor 5y agoNeither a bad experiment nor an unrepresentative sample will be helped by a larger sample size, though.
- danenania 5y agoTrue, though no sample is ever truly representative along every dimension. Even when a lot of effort is put into making a sample as representative as possible, there will be variance in all the potential ways the sample can diverge from the population; this variance seems to be consistently underestimated.
- deleted 5y ago[deleted]