9 ms·

I wonder why they didn't use a in-memory store for deduping. Using something like a bloom-filter could solve their problem it seems.