3 ms·
In a small sample, the observed effect needs to be large in order to cross the threshold for statistical significance. It could still be a fluke and the true ef
by tmalsburg2 7y ago
In a small sample, the observed effect needs to be large in order to cross the threshold for statistical significance. It could still be a fluke and the true effect zero or even negative.
- joombaga 7y agoWhat's the tendency when a study with a small sample size that show a large observed effect get performed on larger samples? Has it been studied?
- tmalsburg2 7y agoIt depends. If the original study was published only because it had a positive result (significance filter, usually true), we expect the effect to be smaller in a larger replication. It's called Type M error, with M for magnitude. And, yes, large scale replications typically show smaller effects or no effects. See this paper for details: https://journals.sagepub.com/doi/full/10.1177/1745691614551642 https://journals.sagepub.com/doi/full/10.1177/17456916145516...