4 ms·
Perhaps offtopic: Is web scraping a desired skill in the job market? Asking because unemployed.
by Toast_ 12y ago
Perhaps offtopic: Is web scraping a desired skill in the job market? Asking because unemployed.
- iheartmemcache 12y agoSort of. There are tons of people offering crawling-as-a-service, where you can do your own scraping. Then there are tools like import.io which let you point-and-click data right into your database. There's scrapy for and similar frameworks for Python. I'm sure node has more than a few npm packages out there to deal with dynamically rendered (e.g. infinite scroll) stuff out there. In short, it's a useful tool to be able to reach for in your toolbelt but not the hammer you'll use every day.
- artmageddon 12y agoMy guess is that web scraping isn't something you're going to see on job postings specifically, but if you can write a web scraper with your favorite programming language, that would be something useful to discuss and maybe even land you an interview.