3 ms·
We also crawl IPv6 but it's a very different and more complicated algorithm. We would still end up crawling a sizable chunk but there are obviously unknowns in
by achillean 5y ago
We also crawl IPv6 but it's a very different and more complicated algorithm. We would still end up crawling a sizable chunk but there are obviously unknowns in how biased our dataset would be (i.e. we might index mostly cloud servers and fewer residential devices).
- hnick 5y agoThat's what I thought, you might have to maintain a map of ISPs and such but even then it'd be hard to find all the clients under them.