6 ms·
Fixed-width binary data (e.g., a sequence of double floats) often benefit from a simpler transform: just transpose the bits/bytes so that, e.g., the least signi
by pkhuong 12y ago
Fixed-width binary data (e.g., a sequence of double floats) often benefit from a simpler transform: just transpose the bits/bytes so that, e.g., the least significant bytes form a contiguous region, followed by all the second least significant bytes, etc.
> Meant for binary data: can take advantage of the type size meta-information for improved compression ratio (using the integrated shuffle pre-conditioner).
makes it sound like that's what Blosc is doing.
- shiningmuppet 12y agoYes, exactly, like so: http://www.blosc.org/images/shuffle.png http://www.blosc.org/images/shuffle.png
- rdc12 12y agoSounds interesting is there a name for that technique? Or more to the point something that can be searched for
- shiningmuppet 12y agowe call it the 'shuffle filter' but that is all