3 ms·
How do you test a system like this for accuracy? Is this done by simulating millions of unique requests?
by noamhacker 9y ago
How do you test a system like this for accuracy? Is this done by simulating millions of unique requests?
- icelancer 9y agoCan't you just use Apache Benchmark and some proxies?
- GhostVII 9y agoReddit probably has enough analytics to be able to show mathematically that it will be accurate without simulating any requests.
- andreareina 9y agoThe algorithm's accuracy is known. From the wiki[1]: The HyperLogLog algorithm is able to estimate cardinalities of > 10^9 with a typical error rate of 2% [1] https://en.wikipedia.org/wiki/HyperLogLog https://en.wikipedia.org/wiki/HyperLogLog
- federicoponzi 9y agoBut what about the implementation accuracy? :)
- zeroxfe 9y agoTests against both historical and synthetic datasets.