4 ms·
some critiques of parquet by andy pavlo https://www.vldb.org/pvldb/vol17/p148-zeng.pdf https://www.vldb.org/pvldb/vol17/p148-zeng.pdf
by apwell23 2y ago
some critiques of parquet by andy pavlo
https://www.vldb.org/pvldb/vol17/p148-zeng.pdf https://www.vldb.org/pvldb/vol17/p148-zeng.pdf
- thesz 2y agoThanks, very insightful. "Dictionary Encoding is effective across data types (even for floating-point values) because most real-world data have low NDV ratios. Future formats should continue to apply the technique aggressively, as in Parquet." So this is not critique, but assessment. And Parquet has some interesting design decisions I did not know about. So, let me thank you again. ;)