3 ms·
You can download zone files for lots of gTLDs using ICANN’s Centralized Zone Data Service [0]. For ccTLDs there’s no centralised system and availability depend
by elliottinvent 5y ago
You can download zone files for lots of gTLDs using ICANN’s Centralized Zone Data Service [0].
For ccTLDs there’s no centralised system and availability depends on the country registry. For example, Nominet make the UK zone file and others available for UK registrars for a fee I think.
Another approach is to buy WHOIS files from providers like Whoxy [1], the registrant data shouldn’t be used because of GDPR and other restrictions but as a domain list it can be useful.
I’ve done a fair bit in this area so if anyone wants any help feel free to send an email - details in profile.
0. https://czds.icann.org/home https://czds.icann.org/home
1. https://www.whoxy.com https://www.whoxy.com
- NKosmatos 5y agoThanks for the hints. I’m interested in collecting all sites/domains for a specific ccTLD (.gr) purely for statistics/curiosity. I know that some countries publish their zones files, but for the GR registry (like many other countries) this is not available. I’m not interested in the WHOIS data, sine as you correctly mention contain sensitive data. I was thinking that somehow if I had my own DNS server I would be able to download all available domains, but after some reading I understood that this is not how DNS servers work. A request from a local client (inside my own LAN) would need to perform an nslookup or web access for each domain, so that the result could be cached.