3 ms·
I tried all of the available compression formats in parquet, natively in duckdb, and compressing raw duckdb files as a whole. IIRC just GZIPing SQLite files bea
by mastax 5y ago
I tried all of the available compression formats in parquet, natively in duckdb, and compressing raw duckdb files as a whole. IIRC just GZIPing SQLite files beat them all. The SQLite files were much smaller uncompressed (~220mb vs 800mb) which was probably most of the difference.
- pletnes 5y agoCan you still query a gzipped sqlite file? What’s the sense in gzipping it if not?
- floydnoel 5y agoDo other formats (Snappy?) allow this?
- benglish11 5y agoYou can query snappy parquet files directly.
- wenc 5y agoYou can also query gzip and zstd parquet files directly.