3 ms·

Very nice! I actually read the FAST '17 paper a while back. I'm curious if HopsFS has any support for partition-pruned secondary index scans? (If not, is it on

Very nice! I actually read the FAST '17 paper a while back. I'm curious if HopsFS has any support for partition-pruned secondary index scans? (If not, is it on the roadmap?) I feel like the lack of it in many current big-data systems is a major bottleneck to adoption for many kinds of workloads.

jamesblonde 9y ago
Do you mean Hive on Hops, I guess? HopsFS is a filesystem (drop-in replacement for HDFS with distributed metadata). Partition-pruned index scans are key for high performance in distributed databases. Index scans and full-table scans hit all shards and kill performance. Hive supports partition-pruned index scans and push-down filtering for projections.