2 ms·
You need a larger dataset if you're dealing with very small probabilities. If you measured millions of events and only saw 1 anomalous event, you have enough da
by lolinder 3y ago
You need a larger dataset if you're dealing with very small probabilities. If you measured millions of events and only saw 1 anomalous event, you have enough data to say that the probability of such an anomaly is extremely rare, but you don't have enough data to compare it to other very rare events.
More concretely: if you flip an unfair coin 1 million times and get a single heads, you know that the odds of getting that heads are extremely low, but you can't yet say what the odds are. It's possible that the odds are one in a million, but it's also possible that you got very lucky or very unlucky relative to the actual odds. You have to have a lot of data in both buckets before you can distinguish.