3 ms·
Cool! I wonder how this would compare to ZFS deduplication.
by cyounkins 5y ago
Cool! I wonder how this would compare to ZFS deduplication.
- veselink1 5y agoAn author here. elfshaker uses per-file deduplication. When building manyclangs packs, we observed that the deduplicated content is about 10 GiB in size. After compression with `elfshaker pack`, that comes down to ~100 MiB. There is also a usability difference: elfshaker stores data in pack files, which are more easily shareable. Each of the pack files released as part of manyclangs ~100 MiB and contains enough data to materialize ~2,000 builds of clang and LLVM.