3 ms·
How would you design it to support mentioned use cases?
by oreoftw 2y ago
How would you design it to support mentioned use cases?
- klaussilveira 2y agoHyperLogLog and PostgreSQL: https://github.com/citusdata/postgresql-hll https://github.com/citusdata/postgresql-hll Or even simpler, Roaring Bitmaps: https://pncnmnp.github.io/blogs/roaring-bitmaps.html https://pncnmnp.github.io/blogs/roaring-bitmaps.html https://blog.quastor.org/p/grab-rate-limiting https://blog.quastor.org/p/grab-rate-limiting https://github.com/RoaringBitmap/CRoaring https://github.com/RoaringBitmap/CRoaring
- philjohn 2y agoHyperLogLog doesn't support exact counters though, does it? That seems to be one of the core requirements of the queue-based solution.
- rshrin 2y agoHyperLogLog (or even Count-Min Sketch) will not support some of the requirements of even the Best-Effort counter (clearing counts for specific keys, decrementing counts by any arbitrary number, having a TTL on counts etc.). For Accurate counters, we are trying to solve for multi-region read/write availability at low single-digit millisecond latency at cheap costs, using the infrastructure we already operate and deploy. There are also other requirements such as tracking the provenance of increments, which play a part.