3 ms·
It can more easily be solved by just not crawling sites that have mandatory javascript, because chances are their content is going to be crap and not worth the
by blueskin_ 12y ago
It can more easily be solved by just not crawling sites that have mandatory javascript, because chances are their content is going to be crap and not worth the time if they are that hostile to basic usability.