3 ms·
Scrapy is a django-like framework. It has more structure and a lot of built-in features compared to using a library like lxml. lxml and Scrapy use the same lib
by cdr 15y ago
Scrapy is a django-like framework. It has more structure and a lot of built-in features compared to using a library like lxml.
lxml and Scrapy use the same library on the backend, libxml2.
http://doc.scrapy.org/faq.html#how-does-scrapy-compare-to-beautifulsoul-or-lxml http://doc.scrapy.org/faq.html#how-does-scrapy-compare-to-be...
http://doc.scrapy.org/topics/selectors.html http://doc.scrapy.org/topics/selectors.html
- wesleyzhao 15y agoIf its a framework does it take a little longer to setup/get used to? If so is the learning curve worth it?
- cdr 15y agoI can't make a fair comparison as far as learning curve, but if you're new to scraping Scrapy might in theory be easier. You get a bunch of tools built-in that you don't have to come up with yourself, and you get a pre-defined way of doing things. However, last time I checked the example project in the docs was a little lacking and there's not many good external examples either. I personally really like having the structure of a framework. It lets me churn out simple project from boilerplate very quickly, and it helps keep larger projects organized.