3 ms·
Couldn't find in the paper a description of how the DAG itself is encoded. Any ideas?
by yubblegum 1y ago
Couldn't find in the paper a description of how the DAG itself is encoded. Any ideas?
- terrelln 1y agoWe left it out of the paper because it is an implementation detail that is absolutely going to change as we evolve the format. This is the function that actually does it [0], but there really isn't anything special here. There are some bit-packing tricks to save some bits, but nothing crazy. Down the line, we expect to improve this representation to shrink it further, which is important for small data. And to allow to move this representation, or parts of it, into a dictionary, for tiny data. [0] https://github.com/facebook/openzl/blob/d1f05d0aa7b8d80627e53080b5dde7aea6a2abc9/src/openzl/compress/encode_frameheader.h#L80-L85 https://github.com/facebook/openzl/blob/d1f05d0aa7b8d80627e5...
- yubblegum 1y agoThanks! (Super cool idea btw.)