4 ms·
Many of the questions here are already answered officially by Google: https://support.google.com/webmasters/answer/178852 https://support.google.com/webmasters/
by tedchs 13y ago
Many of the questions here are already answered officially by Google: https://support.google.com/webmasters/answer/178852 https://support.google.com/webmasters/answer/178852
- chr13 13y agoMay be they should visibly put that FeedFetcher can crawl your website can incur 1TB bandwidth in couple of hours ? May be apache and other httpd should block these crawlers by default ? How else would anyone know about a certain Google feature that could be disaster for them ?