4 ms·
Truth, bots could really be PITA. Still, with log analysis you can remove (at least some of) them, but with JS you can't add them. Same applies to non-page file
by vradmilovic 17y ago
Truth, bots could really be PITA. Still, with log analysis you can remove (at least some of) them, but with JS you can't add them. Same applies to non-page files.
- eli 17y agoRemoving them from the logs sounds difficult. And adding them to JS-based stats doesn't sound very useful. I don't particularly care whether Google indexes my site at 10am or 11am so long as it gets indexed. And I certainly don't care about the comment spam botnets.
- vradmilovic 17y agoOf course the hour of bot's visit is not important, but it could be important to see if it comes every day or not. Not to mention hits to images and other files.
- jonknee 17y agoGoogle's Webmaster tools show how many pages the Googlebot grabs daily and how long requests take, so you can monitor that and rest at night.