I haven't used this for web scraping, but have you tried out http://phantomjs.org/ http://phantomjs.org/. It's a great tool that lets your process webpages; I d

I haven't used this for web scraping, but have you tried out http://phantomjs.org/ http://phantomjs.org/. It's a great tool that lets your process webpages; I don't think it would be that difficult to set it up to scrape sites.