4 ms·
Can you list some specific examples of companies to whom this pertains? By that I mean companies who think their data shouldn't be publicly available and also
by ZoF 12y ago
Can you list some specific examples of companies to whom this pertains?
By that I mean companies who think their data shouldn't be publicly available and also fail to place a no-crawl flag in their robots.txt.
- meritt 12y agoWell, a robots.txt (much like an implicit TOS/EULA that nobody ever sees nor agrees to) isn't exactly legally binding. Yelp, LinkedIn, and Craigslist are examples that have taken legal action recently against other entities scraping and re-purposing the data.