3 ms·
Three more: https://github.com/scrapinghub/portia/ https://github.com/scrapinghub/portia/ (our open source equivalent of Kimonolabs) http://scrapy.org http://
by ddebernardy 11y ago
Three more:
https://github.com/scrapinghub/portia/ https://github.com/scrapinghub/portia/ (our open source equivalent of Kimonolabs)
http://scrapy.org http://scrapy.org (allows to scrape more complex sites; also OSS)
http://scrapinghub.com http://scrapinghub.com (for a cloud-based platform and a smart proxy rotator)
(Disclaimer: working there.)
- kumarski 11y agoscrapinghub is pricy, isn't it?
- ddebernardy 11y agoPricey as in we've a free plan? :-) More seriously though, it's basically a bargain. You get: - Access to the largest team of Scrapy, Portia, and Frontera experts around at your fingertip. - AWS functionality for actually less than what it would cost you to set things up yourself (think VBR IP over ATM). - Smart proxy rotating tech at your fingertip with tens of thousands of IP addresses spread across a slew of different IP networks. - Built-in integrations with a growing list of third parties. The list could go on and on... It's definitely not pricey. :-)