3 ms·A crawling/spidering/scraping framework inspired by Django1 points by greg 18y agotimf 18y agoSee: http://news.ycombinator.com/item?id=411733 http://news.ycombinator.com/item?id=411733