I blocked a number of non Google search bots on one of my smaller sites the other day, increasing the number of bots I have blocked from about 20 to 30. That re

I blocked a number of non Google search bots on one of my smaller sites the other day, increasing the number of bots I have blocked from about 20 to 30. That reduced the load on my database server by over 80%. It's a small site that only generates about $5/day from AdSense, so I need to keep the expenses down on it, and I don't want all of the revenue paying for bots that don't bring in any significant traffic. If I didn't block any search bots, I bet the bots would make up at least 95% of the traffic. On my larger sites I don't mind serving a million page views a day to random search bots, but on that smaller one it doesn't make sense.