3 ms·
Did you consider using the gTLD zone files (from the respective registries) and the ccTLD zone files found @ http://viewdns.info/data/ http://viewdns.info/data/
by howaboutit 11y ago
Did you consider using the gTLD zone files (from the respective registries) and the ccTLD zone files found @ http://viewdns.info/data/ http://viewdns.info/data/? A much bigger initial dataset than 25M domains right there?
- jtwaleson 11y agoNo, getting access will probably take a couple of days (or in case of viewdns, more than 100$) and thereby all the fun out of the project. If you know of any other way to get the list I'd be happy to hear it though!
- adamseabrook 11y agohttp://meanpath.com/freedirectory.html http://meanpath.com/freedirectory.html Feel free to grab a copy of our domain list. The "All domains with NS records" is the one you want. Has 191 million in it.
- breakingcups 11y agoAmazing, thanks!
- jtwaleson 11y agoWow! That's awesome!
- hdmoore 11y agoA shortcut to getting com, net, info, org, us, sk, and biz is to give premiumdrops.com $24.95/mo. You can get these for free from the TLD operators, but it takes a few weeks of snail mail (last I checked). The gTLD access via CZDAP is free, but takes a few days for approvals to process.
- adamseabrook 11y agohttps://czds.icann.org/en https://czds.icann.org/en It has been largely automated now so you can request access to the files with one click vs having to sign and email hundreds of forms. Approval seems to be automatic for most of them.