2 ms·
And while google certainly is important, it isn't the only crawler. Others are important both in "absolute" terms (duckduckgo/bing ?) -- and for "local" and pos
by e12e 13y ago
And while google certainly is important, it isn't the only crawler. Others are important both in "absolute" terms (duckduckgo/bing ?) -- and for "local" and possibly "domain" search (yandex, baidu).
Not to mention internal crawlers for site-wide search (although you can of course adapt those -- why do it if you don't have to?).