If they are blocking to save resources, then it might be worth noting that startup search engines will not bomb their servers the way Google and Bing can. Are t

If they are blocking to save resources, then it might be worth noting that startup search engines will not bomb their servers the way Google and Bing can. Are there any published numbers as to how the crawling load varies from startups to Googlebot?