I can't speak about Mechanize, but I did a project with BeautifulSoup a few months back. For scraping specific elements in a page, the xpath/Firebug integratio

I can't speak about Mechanize, but I did a project with BeautifulSoup a few months back. For scraping specific elements in a page, the xpath/Firebug integration is a huge win. Being able to highlight an item and grab the xpath selector in Firebug saves so much time, it's not even funny.