3 ms·
Dunno about Atlassian and Shopify, but I can’t imagine Google launching a case against someone for scraping them. I guess robots.txt is all that really matters
by Scoundreller 6y ago
Dunno about Atlassian and Shopify, but I can’t imagine Google launching a case against someone for scraping them.
I guess robots.txt is all that really matters.
Here’s Play Store’s: https://play.google.com/robots.txt https://play.google.com/robots.txt
- minnehaha 6y agoagreed, provided the crawler complies with robots.txt
- akudha 6y agoThis data is quite valuable and services like this aren't competing with these app stores. If anything, they are probably inviting more competition to the app stores resulting in better apps. There is no reason for these companies to go after some small guy scraping the app store data. But who knows - Craigslist went after one man shops. These companies might too.