4 ms·
crawled google play data earlier and filtered offline.
by humanbot 9y ago
crawled google play data earlier and filtered offline.
- bbayer 9y agoThanks for the reply. Did you face any issues during crawling process like access restrictions. If you share your practice I will be appreciated.
- humanbot 9y agoMy crawler is modified from https://github.com/KopLyf/GPlayCrawler https://github.com/KopLyf/GPlayCrawler. Crawled 100k+ apps without any access issue.
- nurettin 9y agoI just tested this with `apt install python-scrapy python-pymongo && scrapy crawl google`. It seems to download one by one. Edit: Interesting, it also downloads comments in my locale. Google play seems to be responding according to my IP information.