2 ms·
Have you taken a look at Scrapy (http://scrapy.org/ http://scrapy.org/)? My evolution has been from Perl to Python and I recently did a project with Scrapy that
by dangoldin 13y ago
Have you taken a look at Scrapy (http://scrapy.org/ http://scrapy.org/)? My evolution has been from Perl to Python and I recently did a project with Scrapy that left me pretty happy.
- look_lookatme 13y agoScrapy is really awesome. It's a soup to nuts queuing, fetching and extraction workflow tool and if I had to start a larger than trivial project (like an rss reader or shopping aggregation site) I would base my spider toolchain on it.
- dangoldin 13y agoYea - I was definitely impressed by it and I just got started. It felt as if I was able to get rid of all the boilerplate and just focus on getting the next page that needed to be crawled and the information to extract.