telendram

14 ms·

31.
OpenZFS finally integrates Zstandard transparent compression(github.com)
9 points by telendram 6y ago|0 comments
32.
by telendram 6y ago
> the main reason we settled on Brotli was the second order context modeling This advanced feature is only relevant on reaching compression levels 10 or 11, which are extremely slow. Below that, it's barely used by the encoder, due
33.
by telendram 6y ago
A pure-rust implementation of zstd decoder already exists in production : https://github.com/KillingSpark/zstd-rs
34.
by telendram 6y ago
AES-NI can be used as a hash, but don't assume that it makes a good job at it. Latest version of MeowHash is fine, but all other variants and prior versions have shitty collision ratios, equivalent to a ~50 bits hash : https:/&#
35.
XXH3, world's fastest hash algorithm, has reached stable status(github.com)
74 points by telendram 6y ago|18 comments
36.
Dell Inspiron laptops are sold with malfunctioning heatsinks(reddit.com)
3 points by telendram 6y ago|0 comments
37.
by telendram 7y ago
Even falkhash is not that great, and feature an abnormal amount of collisions as the nb of hashes increase. Basically, all "naive" AES implementations share this design weakness.
38.
by telendram 7y ago
Without `--ultra`, the decompression memory budget is capped at 8 MB. At `--ultra -20`, it's increased to 32 MB. That's still less than XZ, which reaches 64 MB.
39.
by telendram 7y ago
0.8% is with Arch's default settings. It's fairly strong, but not the strongest, to preserve cpu during compression. zstd is used at level 20, but it can compress more. Levels can go up to 22, and (complex) advanced commands are a
40.
by telendram 7y ago
A little known fact is that parallel XZ do compress worse than XZ ! I measured pixz as being approximately ~2% worse than xz. That's because input is split into independent chunks. In comparison, the 0.8% of zstd looks like a bargain.
41.
by telendram 7y ago
Beyond more profound changes to the underlying transport protocol, bandwidth acceleration can be provide through a combination with fast compression. A good setup here would be to pipe data to `tar`, then `zstd`, then `ssh`/`scp`, and
42.
by telendram 8y ago
FP languages tend to consider correctness first, but treat performance, and predictability of performance, as second grade citizens. By performance, I mean both time and space, aka cpu and memory. Cpu is bad, but Memory is by far more criti
43.
by telendram 8y ago
That's a huge stretch. Integer arithmetic is perfectly portable. Defined operations have bit-exact defined results, reproducible on any platform. In contrast, the result of basic floating point operations is not. You may live in a wor
44.
by telendram 8y ago
I'm fine with "just" `struct as strong type` part ...
45.
Strong types in C(fastcompression.blogspot.com)
15 points by telendram 8y ago|3 comments