3 ms·

Wouldn't it be easier if they generated the dom elements via JS? That would imply that they're getting a JSON or something like, parsing it and creating the DOM

by slig 11y ago

Wouldn't it be easier if they generated the dom elements via JS? That would imply that they're getting a JSON or something like, parsing it and creating the DOM.

Ixiaus 11y ago
No because then you'd have to use a headless browser that can execute js. That increases time and cost when scraping, though it wouldn't surprise me if it ends up going that way.
- slig 11y ago
  Why execute the JS? Just parse the JSON (I'm just guessing here). No need to mess with DOM or JS.
  - Ixiaus 11y ago
    From my last and admittedly cursory look it wasn't that simple. IIRC JSON wasn't even used, I think it was a binary protocol.