4 ms·

If everyone somehow magically switched to the much larger IPv6 address space would that be a big problem for you?

• achillean 5y ago
  We also crawl IPv6 but it's a very different and more complicated algorithm. We would still end up crawling a sizable chunk but there are obviously unknowns in how biased our dataset would be (i.e. we might index mostly cloud servers and fewer residential devices).
  • hnick 5y ago
    That's what I thought, you might have to maintain a map of ISPs and such but even then it'd be hard to find all the clients under them.