3 ms·
7z the csv. Get a million rows from your table. Compare the csv to the 7z. That will give you a good idea on what kind of compression you will see. I have very
by sin7 8y ago
7z the csv. Get a million rows from your table. Compare the csv to the 7z. That will give you a good idea on what kind of compression you will see.
I have very redundant data. I often see 10:1 compression. It's a lot less when I have hashes, addresses and timestamps.
- dikei 8y agoIn addition, columnar format like the one used by Click House can often be compressed even better than row format like CSV due to the similarity between value in a column.
- devereaux 8y agoAnd no need to play with columns ordering like with psql: https://blog.2ndquadrant.com/on-rocks-and-sand/ https://blog.2ndquadrant.com/on-rocks-and-sand/