Another option is to use an IBLT (Inverted Bloom Lookup Table). it is easy to implement. I recently wrote a file repair tool that uses it: https://github.com/th

Another option is to use an IBLT (Inverted Bloom Lookup Table). it is easy to implement. I recently wrote a file repair tool that uses it: https://github.com/thomasmueller/tinyStats/blob/master/src/main/java/org/tinyStats/tools/FileRepair.java https://github.com/thomasmueller/tinyStats/blob/master/src/m... (not production ready)