4 ms·
1) replacing gzip compression with zstd will speed things up by a lot while also reducing disk size 2) Plain old sqlite seems like a good idea, for a format (a
by out_of_protocol 1y ago
1) replacing gzip compression with zstd will speed things up by a lot while also reducing disk size
2) Plain old sqlite seems like a good idea, for a format (and also widely supported). Fast indexes included
3) combining (1) and (2) is probably a good idea as well
4) there's also Parquet