4 ms·

It looks similar to LZSSE. We tried it in ClickHouse, but then removed it: https://github.com/ClickHouse/ClickHouse/pull/24424 https://github.com/ClickHouse/Cl

It looks similar to LZSSE. We tried it in ClickHouse, but then removed it: https://github.com/ClickHouse/ClickHouse/pull/24424 https://github.com/ClickHouse/ClickHouse/pull/24424 Reasons: - the decompression speed is slightly better than for lz4, but the compression speed is low; - the code was non-perfect, and the fuzzer has found issues. LZSSE library was abandoned five years ago, but they have great blog posts to read: https://github.com/ConorStokes/LZSSE https://github.com/ConorStokes/LZSSE Iguana looks promising, but AVX-512 requirement is too restrictive. We need something to work both on x86 and ARM. Also, integrating Go assembly into other software is not easy. And A-GPL license makes it incompatible.

xxpor 3y ago
Looks like they switched from AGPL to Apache 2 last week? https://github.com/SnellerInc/sneller/commit/05410a85f900e02f1cf97cdb57c77feae0d695b4 https://github.com/SnellerInc/sneller/commit/05410a85f900e02...
- zX41ZdbW 3y ago
  This is amazing news! PS. Interesting if someone has experience integrating Go Asm dialect into C or C++ build system? We needed it for another experiment https://github.com/ClickHouse/ClickHouse/issues/45130#issuecomment-1454755111 https://github.com/ClickHouse/ClickHouse/issues/45130#issuec...
Asm2D 3y ago
A C version of the library with a portable implementation and AVX-512 optimizations is planned.