4 ms·
Brings up nostalgic memories from my previous life building distributed analytics systems. We had a fully distributed, scalable, real-time OLAP cube 10 years ag
by random3 5y ago
Brings up nostalgic memories from my previous life building distributed analytics systems.
We had a fully distributed, scalable, real-time OLAP cube 10 years ago on top of HBase and Storm (or any other realtime processing pipeline). It was less than 30 KLOC and could be used as a library as well as fully distributed system.
There are several OSS solutions but I still weep every time I think about the stupid reasons for which we delayed open-sourcing it. It was such a simple and scalable data model including many concepts that were not common at the time.
https://medium.com/hstackdotorg/hbasecon-low-latency-olap-with-hbase-d036233cb373 https://medium.com/hstackdotorg/hbasecon-low-latency-olap-wi...
I still believe there's room for a similar simple approach, likely taking advantage of some of the developments related to Algebird, Calcite, Gandiva, etc.