3 ms·
Anyone know how this was made? As I understand it is not so easy to scrape LinkedIn at scale.
by runarb 11y ago
Anyone know how this was made? As I understand it is not so easy to scrape LinkedIn at scale.
- saaaam 11y agoHey - author here. I used casperjs to do the scraping. It was a pain in the ass and I got temporarily banned a few times...
- DyslexicAtheist 11y agoI tried this last year and was blocked after the scraper visiting 500 profiles for 24 hrs. not sure if tarpitting would have allowed more than 500 in 24 hrs. requests were spread with a random sleep of 1-5 seconds.