4 ms·
There are only 602 pages of Google.com indexed on Google.com, mostly 'plus' profiles. Quite a few show with this message: A description for this result is not
by Theodores 13y ago
There are only 602 pages of Google.com indexed on Google.com, mostly 'plus' profiles. Quite a few show with this message:
A description for this result is not available because of this site's robots.txt – learn more.
Which is odd.
- eli 13y agoGoogle will still index pages blocked by robots.txt, it just won't crawl them (so it can't get a description/preview snippet). It indexes them based on the URL and how people link to them.