Also worth checking out is Scrapy: http://scrapy.org/ http://scrapy.org/ It's a Python scraping framework based on Twisted. It lets you use some of Mechanize's

Also worth checking out is Scrapy: http://scrapy.org/ http://scrapy.org/ It's a Python scraping framework based on Twisted. It lets you use some of Mechanize's API to describe the scraping jobs.