2 ms·
Looks awesome and I don't want to detract. But a few things from the documentation to be aware of: - Q: Is this library production ready? A: I wouldn't
by rkagerer 4y ago
Looks awesome and I don't want to detract. But a few things from the documentation to be aware of:
- Q: Is this library production ready?
A: I wouldn't trust it with my data (yet). Make sure you have backups of everything.
- usual zstd checksum is stripped from compressed data
- columns you want to index can't be compressed
- works best with rows containing less than ~30kB of data
- deleted 4y ago[deleted]
- charcircuit 4y agoFrom the readme Zstandard is currently deployed within Facebook. It is used continuously to compress large amounts of data in multiple formats and use cases. Zstandard is considered safe for production environments.
- asveikau 4y agoThat's a statement about the block compression algorithm. The part that is claimed as not production ready is the third party sqlite integration. Skimming the code I can see why. It does some pretty gnarly things involving altering the schema of all your tables. Not to say it doesn't work or isn't good, but, it seems like it really does a lot of intrusive, potentially failure prone stuff.