3 ms·
gzip probably would have been fine for that case even without parquet?
by alisonkisk 6y ago
gzip probably would have been fine for that case even without parquet?
- prepend 6y agoGzip did help, but not as much as parquet. I don’t remember the exact sizes but I think parquet was was 3GB->20MB and gzip was like 3GB->180MB or something. Also gzip was an extra step of unzip then read.