4 ms·
Two great tools for web scraping are https://import.io/ https://import.io/ and https://www.kimonolabs.com/ https://www.kimonolabs.com/. There are also lots of d
by dennybritz 12y ago
Two great tools for web scraping are https://import.io/ https://import.io/ and https://www.kimonolabs.com/ https://www.kimonolabs.com/. There are also lots of developer tools out there, the most popular is probably http://scrapy.org/ http://scrapy.org/.
If you are interested in web crawling, which is often necessary if you want to extract data from very large sites (or many sites), I just wrote up a blog post comparing open source web crawling systems (including scrapy): http://blog.blikk.co/comparison-of-open-source-web-crawlers http://blog.blikk.co/comparison-of-open-source-web-crawlers
- webmaven 12y agoThanks for linking to those services, and your comparison of crawler libraries is very well done.