also Microsoft owns the number 2 search engine no one is blocking Microsoft from scraping their sites else they loose all that traffic from Bing searches. I sus

also Microsoft owns the number 2 search engine no one is blocking Microsoft from scraping their sites else they loose all that traffic from Bing searches. I suspect the same with google thus googles deals are strictly speaking an anti competitive measure and insurance against the law deciding against them