4 ms·
We use HTMLUnit. Works pretty well. Not super fast, but you want to scrape individual sites at a moderate rate anyway
by elchief 10y ago
We use HTMLUnit. Works pretty well. Not super fast, but you want to scrape individual sites at a moderate rate anyway
- skinnymuch 10y agoHave you run into issues? I'd think HTMLUnit isn't robust enough and it's "browser" Ian limiting?
- elchief 10y agoIt's got a couple of idiosyncrasies but works well in general. Barfs out too much log info in general. XPath 1 is limiting, but can use Saxon if need to
- skinnymuch 10y agoHoly crap! Xpath 1 is still being used for it? I actually have no clue what the differences are between xpath versions but I just assumed everyone is on xpath 2. I guess my other question is - have you run into any situations where the JavaScript parsing or browser rendering wasn't good enough?