4 ms·
is this really a contrarian opinion? i feel like this is a pretty obvious fact that it's easier to read network requests to scrape a website than parsing html
by jtmarmon 10y ago
is this really a contrarian opinion? i feel like this is a pretty obvious fact that it's easier to read network requests to scrape a website than parsing html
- alanwatts 10y agoIs there a specific tool you would recommend for doing this?
- thomasahle 10y agoI'm not sure why, but many scraping tools handle javascript websites by emulating clicks and running the javascript.
- jandrese 10y agoI think the idea is that clicking on the button is less likely to change suddenly than whatever protocol they're running on top of AJAX. In my experience internal layout changes seem to happen way more often than changes to the AJAX handlers.