Surprised no one has mentioned weboob. If your interest isn't specifically along the lines of "go to all pages, and get all of the data" and more along the line

Surprised no one has mentioned weboob. If your interest isn't specifically along the lines of "go to all pages, and get all of the data" and more along the lines of "go to my bank, log in using username and password, get the transactions" etc, weboob is ideal. It seems to be extremely well thought out and easily extendable.it has plugins for a whole bunch of websites already, including many, many banks, some of the biggest websites such as reddit, Google, and many more. The only downside I've had so far is that it will fall flat on it's arse if the website has to load must do javascripty things (it can handle APIs and html easily though).