I actually love Selenium for this purpose, for much the same reasons the author mentions here. It's almost impossible for a website to reliably detect that a c

I actually love Selenium for this purpose, for much the same reasons the author mentions here. It's almost impossible for a website to reliably detect that a client web browser is being automated, and I find I can make Selenium scripts much more adaptable to breaking changes in websites when they occur than I can when hooking up my code directly. I actually disagree with the contention that Selenium is slower than directly scraping though. The Firefox driver has always been lightning fast for me and the bottleneck is almost always server requests that would have been necessary either way.