2 ms·
> You seem to underestimate how heavily ClickHouse is optimized (e.g. compressed storage). Is it any more compressed than Apache Hive's ORC format (https://orc
by derefr 7y ago
> You seem to underestimate how heavily ClickHouse is optimized (e.g. compressed storage).
Is it any more compressed than Apache Hive's ORC format (https://orc.apache.org https://orc.apache.org)? Because that's increasingly accepted as a storage format in a lot of these analytical systems.
- deepsun 7y agoYes, looks like it. According to these posts, ORC only uses snappy or zlib compression, while Clickhouse uses double-delta, Gorilla, and T64 algorithms. https://engineering.fb.com/core-data/even-faster-data-at-the-speed-of-presto-orc/ https://engineering.fb.com/core-data/even-faster-data-at-the... https://www.altinity.com/blog/2019/7/new-encodings-to-improve-clickhouse https://www.altinity.com/blog/2019/7/new-encodings-to-improv...
- marcinzm 7y agoORC or Parquet are file storage formats so without context their performance can be almost anything. Where is the data stored? S3? HDFS? Local ram disk? Clickhouse manages the whole distributed storage, ram caching, etc. thing for you. In my experience, a unified single purpose vertically integrated solution will be faster than a bunch of kitchen sink solutions bolted together.