3 ms·
Take the data in your database, 7zip it. If your data is very redundant, you'll see great compression. If it's not you won't.
by sin7 8y ago
Take the data in your database, 7zip it. If your data is very redundant, you'll see great compression. If it's not you won't.
- paulryanrogers 8y agoYou mean 7z the raw SQL? Just as a preemptive check before moving to Clickhouse?
- sin7 8y ago7z the csv. Get a million rows from your table. Compare the csv to the 7z. That will give you a good idea on what kind of compression you will see. I have very redundant data. I often see 10:1 compression. It's a lot less when I have hashes, addresses and timestamps.
- dikei 8y agoIn addition, columnar format like the one used by Click House can often be compressed even better than row format like CSV due to the similarity between value in a column.
- devereaux 8y agoAnd no need to play with columns ordering like with psql: https://blog.2ndquadrant.com/on-rocks-and-sand/ https://blog.2ndquadrant.com/on-rocks-and-sand/