3 ms·
Sadly this is a limitation of the design. The index is built from domain data etc; the crawl list contains hundreds of millions of domains, but the system has o
by mutatio 12y ago
Sadly this is a limitation of the design. The index is built from domain data etc; the crawl list contains hundreds of millions of domains, but the system has only indexed 3.6 million so far over the past few days :(
I initially started with the Alexa top million, so coverage there should be good, so long as the TLD is supported.