4 ms·
How does this compare to https://github.com/RoaringBitmap/CRoaring https://github.com/RoaringBitmap/CRoaring? Is the difference that this one is distributed?
by mrdmnd 9y ago
How does this compare to https://github.com/RoaringBitmap/CRoaring https://github.com/RoaringBitmap/CRoaring?
Is the difference that this one is distributed?
- travisturner 9y agoPilosa actually uses Roaring internally for bitmap compression (in fact, one of the Pilosa devs did the first port of Roaring from Java to Go). One difference is that really wide bitmaps are sharded and distributed among nodes in the cluster. This allows Pilosa to parallelize the work of doing bitwise operations on high cardinality data.
- jaffee 9y agoI'll add to travisturner's response - Pilosa has a few bells and whistles beyond being a straight up bitmap index including: - associating each bit with a timestamp (at various granularities) and queries over time ranges. - adding arbitrary key/value metadata to each row or column - automatic sorting/caching of bitmaps to support "TopN" queries
- mrdmnd 9y agoNeat, thanks for the clarifications. Looks like a cool tool.