2 ms·
Unfortunately that advice is hugely misleading. The reason is that the p-value essentially tells you how repeatable your analysis will be, but doesn't say anyth
by RA_Fisher 12y ago
Unfortunately that advice is hugely misleading. The reason is that the p-value essentially tells you how repeatable your analysis will be, but doesn't say anything about how beneficial making the decision might be. Second, there is a relationship between how large the difference between outcomes are and how many people you need. So if taking your conversion rate from 10 to 15% would be really helpful to your business, you might need say thousands of people to notice that difference statistically.
- cgearhart 12y ago> The reason is that the p-value essentially tells you how repeatable your analysis will be Your statement contradicts the introductory paragraph of the article: > "...the outcomes of these tests are mistakenly believed to yield the following information:... the probability that an initial finding will replicate; ..." The p-value is the likelihood that the observed effect is due only to chance, not a measure of the repeatability of a result.
- RA_Fisher 12y agoAh yes, you're right! I made a statement about likelihood!