3 ms·
I have to scrape the whole IP address space since I offer location information as part of my API. Also I only need to scrape as many WHOIS records as there are
by incolumitas 3y ago
I have to scrape the whole IP address space since I offer location information as part of my API.
Also I only need to scrape as many WHOIS records as there are different networks out there. So for example for the IPv4 address space, there are much less networks as there are IPv4 addresses (2^32).
Also, most RIR's provide their WHOIS databases for download.
Therefore, "scraping" is not really the correct word, it's an hybrid approach, but mostly based on publicly available data from the five RIR's.
- notlukesky 3y agoWhat was the easiest and the most frustrating part?
- incolumitas 3y agoLACNIC is a fucking pain in the ass since they block after like 27 records ARIN is awesome