varunsharma

3 ms·

1. 1.▲
   by varunsharma 11y ago

   Suspect it would be difficult. There are differences like new data is completely independent of previous data and the source of truth for region distribution is HDFS for the block locations. There are multiple replicas per shard while HBas
2. 2.▲
   by varunsharma 11y ago

   That is correct, we are using the functionality similar to HBase. We pull in the HBase BlockCache library with some tweaks to make it work for our scenario. Note that data is never overwritten and HFiles are immutable. So the cache automati
3. 3.▲
   by varunsharma 11y ago

   This is Varun from Pinterest. We did look at a few options before building this. ElephantDB seemed a bit heavy handed, such as having to modify ring configuration every time we added/removed servers and also, modifying domain spec yaml