For simple, scripted, one-off tasks, I've had good experiences with Beautiful Soup for Python[1]. If it's necessary that the javascript actually gets executed

For simple, scripted, one-off tasks, I've had good experiences with Beautiful Soup for Python[1]. If it's necessary that the javascript actually gets executed though, you're more likely to need something like headless chrome (recently on HN [2]) or PhantomJS [3], but I can't speak to how easy they are to use, though. [1]: https://www.crummy.com/software/BeautifulSoup/bs4/doc/ https://www.crummy.com/software/BeautifulSoup/bs4/doc/ [2]: https://news.ycombinator.com/item?id=14101233 https://news.ycombinator.com/item?id=14101233 https://news.ycombinator.com/item?id=14239194 https://news.ycombinator.com/item?id=14239194 [3]: http://phantomjs.org/ http://phantomjs.org/