3 ms·
The standard deviation is 0.8 for a single HLL, but a ratio involving 2 of them will have about 1.6%. Simple arithmetic: conversions x (1+0.008) / [visitor
by yummyfajitas 11y ago
The standard deviation is 0.8 for a single HLL, but a ratio involving 2 of them will have about 1.6%. Simple arithmetic:
conversions x (1+0.008) / [visitors x (1 - 0.008)
~ (conversions / visitors) (1 + 2 x 0.008 + ...)
~ (conversions / visitors) (1 + 0.016 + ...)
(It should actually be a bit less if you do the calculation carefully, probably 1.6/sqrt(2).) 12kb is also a pretty big filter, but I guess reasonable.
It's definitely true that non-statistical errors are highly likely to drown this out. But why have extra error if you don't need it?
- gingerlime 10y agoTotally agree. Should aim to reduce error rates as much as possible. That's one of the reasons I was also exploring BigQuery. Any tips for implementing this with bloom filters using redis/python and how to reduce or even estimate error rates there?