4 ms·
Not entirely. Even if run right after one another, running two tests buckets the results into early/late, which simply using a larger sample set does not. Assu
by EdHominem 10y ago
Not entirely. Even if run right after one another, running two tests buckets the results into early/late, which simply using a larger sample set does not.
Assume your first samples show the effect and the later ones don't. The first test will show a strong correlation and the second not. The larger test will simply show a weaker correlation.
- Vinnl 10y agoSo what would the conclusions be in the two-test and large-test case? My assumption would be that if one of the two tests would fail, then the correlation in a large test would also have been so low as to mean no effect?
- EdHominem 10y agoThe issue is that you probably wouldn't do two tests if you'd planned a short one. So you'd randomly get an overly strong, or overly weak, result. The actual effect depends on your data and how noisy it is, and if that correlates to external factors, etc. You need to know the characteristics of your data then you can decide on your desired confidence and only then pick a test designed to give you that based on your data.