2 ms·
It's possible the author may have intended that: .1 since search results are only accessed through a search action, and not links in the wild .2 since even if
by riffraff 16y ago
It's possible the author may have intended that:
.1 since search results are only accessed through a search action, and not links in the wild
.2 since even if links in the wild are followed the google bot should have respected the disallow /search rule (which may have no standard, but google usually respect the format used in that robots.txt, and results are in both cases as of this writing)
3. therefore, they got to know such pages by using clickstream data
But I'm just guessing.