This sample set is way too small to be arguing about a millisecond here or there. The variation from what's cached, or if something else happens on the machine

This sample set is way too small to be arguing about a millisecond here or there. The variation from what's cached, or if something else happens on the machine, or whatever is going to affect the benchmarks. For a 'real' benchmark, I'd like to see a few gigs of data, or something that's not going to fit in cache. The real gain from the bloom filter is going to be in a 4-10x reduction in the working set for the same amount of data. But when the working set is trivial, then the fluctuating and fixed overheads are going to dominate. I'd also like to see how good the bloom filter's indexing is at scale, or if it winds up being some sort of table scan.