3 ms·
Hey - author here. I used casperjs to do the scraping. It was a pain in the ass and I got temporarily banned a few times...
by saaaam 11y ago
Hey - author here. I used casperjs to do the scraping. It was a pain in the ass and I got temporarily banned a few times...
- DyslexicAtheist 11y agoI tried this last year and was blocked after the scraper visiting 500 profiles for 24 hrs. not sure if tarpitting would have allowed more than 500 in 24 hrs. requests were spread with a random sleep of 1-5 seconds.