3 ms·
Removing them from the logs sounds difficult. And adding them to JS-based stats doesn't sound very useful. I don't particularly care whether Google indexes my s
by eli 17y ago
Removing them from the logs sounds difficult. And adding them to JS-based stats doesn't sound very useful. I don't particularly care whether Google indexes my site at 10am or 11am so long as it gets indexed. And I certainly don't care about the comment spam botnets.
- vradmilovic 17y agoOf course the hour of bot's visit is not important, but it could be important to see if it comes every day or not. Not to mention hits to images and other files.
- jonknee 17y agoGoogle's Webmaster tools show how many pages the Googlebot grabs daily and how long requests take, so you can monitor that and rest at night.