3 ms·
Which begs the question, are there regions of the web that just simply aren't indexed?
by squidsoup 16y ago
Which begs the question, are there regions of the web that just simply aren't indexed?
- patrickaljord 16y agoThose that blacklist googlebot on their robots.txt
- mfukar 16y ago...allegedly.
- Matt_Cutts 16y agoAbsolutely there are, despite our efforts. See the bmtcinfo.com example mentioned elsewhere on this page. But normally there's a good reason if we don't have a page, e.g. bmtcinfo.com returns an error unless you add a "www" in front of it.