4 ms·
We use Scrapy for a few projects and it is really really good. They have a commercial-side to them, which is fine, but for anyone doing crawling/scraping I'd st
by inovica 11y ago
We use Scrapy for a few projects and it is really really good. They have a commercial-side to them, which is fine, but for anyone doing crawling/scraping I'd strongly recommend it. Good article also
- IanCal 11y agoSame, it's really nicely put together, lots of sensible defaults and it's easy to add your own bit of awkward logic when necessary.