This looks interesting. Can be used for deduplication by keeping this hash table on disk for large amount of data I wrote something like this to optimize disk

This looks interesting. Can be used for deduplication by keeping this hash table on disk for large amount of data I wrote something like this to optimize disk seeks heavily by returning a reference of 8 byte and keeping a hashtable in memory. A mostly-append only records store that allowing mutations of same key and by rounding size of blobs by power of 2. Written to optimize storage layer for Membase. https://github.com/t3rm1n4l/lightkv https://github.com/t3rm1n4l/lightkv