3 ms·
I'm so tired of these job search sites not respecting the search terms I enter. What is a good way to web scrap them so that I can do my own offline filtering.
by OnionBlender 2y ago
I'm so tired of these job search sites not respecting the search terms I enter. What is a good way to web scrap them so that I can do my own offline filtering.
LinkedIn is the worst. Microsoft inserts their own "Promoted" jobs that don't contain the words I search for and the job title is very generic.
- entrepy123 2y ago> What is a good way to web scrap [sic] them Maybe using Scraping Fish [0]? Per [1], "They [scrapingfish.com] seem to handle all the more annoying parts of web scraping: bypassing anti scraping things such as rate limits and captchas." [0] https://scrapingfish.com/ [1] https://news.ycombinator.com/item?id=39110789
- gessha 2y agoI’m looking for a job right now and the website is more usable in incognito mode. I think the trash they recommend is due to somebody’s bad recommendation algorithm similar to Amazon’s “you want another mattress?” problem.
- m463 2y agowhat I found interesting is that you can update your amazon recommendations. I remember being able to do that years and years ago, but I thought they took it away. but it is still there, just hard to navigate to: https://www.amazon.com/gp/yourstore/iyr/ https://www.amazon.com/gp/yourstore/iyr/ There is even still a list of "not interested" put I don't seem to be able to find the UI to add things to that list.