4 ms·
I started with selenium and still use it when I have to but try to just make http requests and parse responses directly whenever possible. Probably my favorite
by staticautomatic 7y ago
I started with selenium and still use it when I have to but try to just make http requests and parse responses directly whenever possible. Probably my favorite travel-related script was one that watched for an opening at a hard to book hotel and snatched it up when it became available.
- beatthatflight 7y agoand to parse the responses (Assuming they're HTML page sources, not json/xml) - you using scrapy or something else?
- staticautomatic 7y agoI pretty much always use lxml. It has an html method but I typically just use etree.parse(). It's very fast and has excellent XPath query support.