3 ms·
Scraping is mostly useful if you're trying to get at some structured data or something. (Though you might be thinking of "readability" modes which work by assig
by cooper12 11y ago
Scraping is mostly useful if you're trying to get at some structured data or something. (Though you might be thinking of "readability" modes which work by assigning scores to what it thinks is content) For sites like these I figure that using noscript or a headless browser like w3m can suffice. My layperson understanding is that Adblock works at the network level by blocking requests to addresses on its blacklist.
- blisterpeanuts 11y agoUnfortunately, text browsers like Lynx and Links have been locked out of many sites. When I go to forbes.com using links, it lets me click on the "30 under 30" article, but then I get a mostly blank screen and can go no further. Life on the web must be tough for the sight-impaired, as well. Too bad it's gone in this direction.
- cooper12 11y agoWow, you weren't kidding. All I get under w3m is: > 30 under 30 2016 > true where I'm hoping "true" isn't the result of some test by a lazy dev. Spoofing my user agent to firefox actually gives me a completely blank page... It is a indeed a sad state.
- ksml 11y agoThis is probably a consequence of relying on AJAX to load content, and not of using a text-based browser. If I visit Forbes in Firefox with noscript enabled, I also get a mostly blank screen.