It's OK when you only have to crawl one or two websites, sure, manually analyze the js and write minimal DOM parsing routes would do. But how about hundreds or

It's OK when you only have to crawl one or two websites, sure, manually analyze the js and write minimal DOM parsing routes would do. But how about hundreds or thousands of websites to crawl? Or do you prefer just use phantomjs write static extraction rules.