3 ms·
Sort of. There are tons of people offering crawling-as-a-service, where you can do your own scraping. Then there are tools like import.io which let you point-an
by iheartmemcache 12y ago
Sort of. There are tons of people offering crawling-as-a-service, where you can do your own scraping. Then there are tools like import.io which let you point-and-click data right into your database. There's scrapy for and similar frameworks for Python. I'm sure node has more than a few npm packages out there to deal with dynamically rendered (e.g. infinite scroll) stuff out there. In short, it's a useful tool to be able to reach for in your toolbelt but not the hammer you'll use every day.