2 ms·
> you really want to have data distributed across machines It's funny how poorly Hadoop, HDFS, and HBase learned this lesson. HBase tries to keep a replica of
by jeffbee 3y ago
> you really want to have data distributed across machines
It's funny how poorly Hadoop, HDFS, and HBase learned this lesson. HBase tries to keep a replica of its data on the local machine, under the incorrect belief that a local RegionServer (approx: chunk server) will be somehow better than a building full of them. This is why HBase performance is hideous. But it is all supposedly inspired by or modeled after GFS and Bigtable?
- woooooo 3y agoIf I recall correctly, hbase performance problems had a lot to do with jdk 1.6 garbage collection, rather than the data location strategy.
- jimbokun 3y agoHadoop and family fell squarely in the category of something where I always felt I was missing something important. Because it was being discussed everywhere, but I could never match it up with a problem I needed to solve, even though we were dealing with other “big data” systems.