3 ms·
This is a great list—to add two categories: If you need bloom filters, then use split block bloom filters [1] which use SIMD to increase speed from 30%-450%.
by _vvhw 4y ago
This is a great list—to add two categories:
If you need bloom filters, then use split block bloom filters [1] which use SIMD to increase speed from 30%-450%.
If you need erasure coding, then use Cauchy Reed-Solomon instead of Reed-Solomon. Cauchy Reed-Solomon uses pure XOR so you can do erasure coding at the speed of per-core memory bandwidth.
[1] https://arxiv.org/abs/2101.01719 https://arxiv.org/abs/2101.01719