5 ms·
Maybe they are. How can we know? Maybe they just scrap every google page, as a way to circumvent robots.txt. (5 years ago no one would have given msft the benef
by zzleeper 16y ago
Maybe they are. How can we know?
Maybe they just scrap every google page, as a way to circumvent robots.txt. (5 years ago no one would have given msft the benefit of the doubt, b/c we've all seen their track record, funny how they are now perceived as the up-and-coming guy in the game)