3 ms·
What sites are you searching? I built a web scraper to help automate my job search in NOLA http://nolatechjobs.leesome.com/ http://nolatechjobs.leesome.com/ I
by gee_totes 12y ago
What sites are you searching? I built a web scraper to help automate my job search in NOLA
http://nolatechjobs.leesome.com/ http://nolatechjobs.leesome.com/
I'd be happy to share the code with you and you could switch out the sites I'm scraping with the ones you look at. The whole thing runs on a cronjob that just re-generates the HTML every hour.
- vonmoltke 12y agoRight now when I look I usually use Indeed and StackOverflow. I gave up on the big boys (Monster, CareerBuilder, Dice) because the sites are so polluted by recruiters and the filtering tools are so poor. I'd love to try your scraper. I've thought about doing something like that before, particularly since I have started doing lots of web scraping for work and I am much more comfortable with it. Do you have any issues with sites that actively or passively discourage scrapers?
- gee_totes 12y agoNope, haven't run into any issues. I scrape Craigslist from RSS and the others from the HTML. I only hit the sites once an hour, and leave a unique browser string so they can filter me out of their analytics. My e-mail is in my profile and I'll be happy to send over the code.