4 ms·
> That feels like a bigger problem to me than people actually getting good data but then using it too confidently P value alone does not tell you whether you h
by snowwrestler 11y ago
> That feels like a bigger problem to me than people actually getting good data but then using it too confidently
P value alone does not tell you whether you have good data. It just tells you how well a particular model fits the data that you have. It won't (and can't) tell you if your data set is missing data that would alter the P value were it to be included.
P value alone is not enough to say "good" or "bad." That's why this statement matters.
- wdewind 11y agoI'm not sure I agree. If P-value is really low then it implies either the existing data set is bad or your new data set is bad. Either way you haven't used data to get to a confident decision. Put another way: tons of stuff in prod dev gets done without p-values entirely because it's the first time you have any data at all about something. I'm questioning whether this is hugely valuable and obviously better than using my intuition or not, since we really don't have a good understanding of the baseline.
- deleted 11y ago[deleted]
- deleted 11y ago[deleted]