2 ms·
> it is understandable that you want to be in phonebook but also that you dont want somebody random to enter, use your resources and copy everything because of
by lazyjones 9y ago
> it is understandable that you want to be in phonebook but also that you dont want somebody random to enter, use your resources and copy everything because of some other interests.
It's not that simple: Google has used scraped content in the past to build competing products to the sites it was from. Examples: reviews from shopping sites for Google Shopping, Yelp reviews for Google Places.
Google can do it because it basically owns your front door. Everyone else can't.
> at this point i have the whole aws ip range blocked.
From past experience: this will likely block some apps, possibly services like Alexa from accessing your site.