3 ms·
I'm curious on this. Why wouldn't statistical compression go smaller? Assuming you restrict the statistics in question to be tailored to the metadata that is
by taeric 2y ago
I'm curious on this. Why wouldn't statistical compression go smaller? Assuming you restrict the statistics in question to be tailored to the metadata that is being compressed, it feels like it should be comparable? Yes, you may need/want to store a precomputed dictionary at the receiving end so that you aren't sending that every time, but that is really no different from having custom code that you need at receiving end. Right?
- chaokunyang 2y agoThe thing is that we can't store a precomputed dictionary. Fury is just a serialization framework, we don't know which data will be serialized
- taeric 2y agoIf you can store new code, you can get a more optimized dictionary for what you are doing, though? Why not?
- chaokunyang 2y agoYes, if we can. The users of Fury may be able to do this. Fury may only provide such an interface to users to let them pass such an dict/zstd/huffman or something like