29 ms·
Nifty! A few questions if you don't mind? - What is the source for your list of names to generate the Bloom filters? - How many names do you estimate are in
by pudquick 13y ago
Nifty!
A few questions if you don't mind?
- What is the source for your list of names to generate the Bloom filters?
- How many names do you estimate are in the list(s)?
- How long does it take to generate the Bloom filters?
- I would assume your filters are based on registered domains, so when you get a positive match do you verify it with a Whois lookup to account for the false positives Bloom filters generate?
Also - any thoughts on open sourcing this? My primary concern with third-party domain search engines like this is them lying / stealing my domain ideas. Running a search like this locally would be very interesting.
- tectonic 13y agoGlad you like it! The domain name list is provided in an 8GB dump from Verisign. You sign up to get access, but the process isn't too bad. There are around 100 million registered .com domains right now. Building the bloom filter takes about 20 minutes. It would be smart to double check with Whois data, but that would slow the process down. Right now I link to the registrars instead since they will do the Whois verification. I'd definitely consider open sourcing or collaborating on the code. Send me a note.
- pudquick 13y agoThanks for responding! For anyone looking for that Verisign program, this page appears to have the info: http://www.verisigninc.com/zone http://www.verisigninc.com/zone
- danshapiro 13y agoIt would be neat if someone could post it publicly. Sounds like a fun dataset to experiment with.