4 ms·
Right now when I look I usually use Indeed and StackOverflow. I gave up on the big boys (Monster, CareerBuilder, Dice) because the sites are so polluted by rec
by vonmoltke 12y ago
Right now when I look I usually use Indeed and StackOverflow. I gave up on the big boys (Monster, CareerBuilder, Dice) because the sites are so polluted by recruiters and the filtering tools are so poor.
I'd love to try your scraper. I've thought about doing something like that before, particularly since I have started doing lots of web scraping for work and I am much more comfortable with it. Do you have any issues with sites that actively or passively discourage scrapers?
- gee_totes 12y agoNope, haven't run into any issues. I scrape Craigslist from RSS and the others from the HTML. I only hit the sites once an hour, and leave a unique browser string so they can filter me out of their analytics. My e-mail is in my profile and I'll be happy to send over the code.