5 ms·

Wow... that Motherboard web page is packed with enough cruft to bring my brand new Kaby Lake i5 to its knees.

by kstenerud 10y ago

jackyinger 10y ago
Yeah, that's why I don't read vice sites anymore...
shrimp_emoji 10y ago
What web page? https://snag.gy/skEJYT.jpg https://snag.gy/skEJYT.jpg
- turbohedgehog 10y ago
  What picture? http://i.imgur.com/srEiiD7.png http://i.imgur.com/srEiiD7.png
agumonkey 10y ago
Lucky for you next generation will accelerate internet. Save your money.
10165 10y ago
Assuming nothing listening on 127.0.0.1, this should fix the problem. cat << eof >> /etc/hosts 127.0.0.1 vice-web-statics-cdn.vice.com 127.0.0.1 fonts.googleapis.com 127.0.0.1 www.google-analytics.com 127.0.0.1 d31qbv1cthcecs.cloudfront.net 127.0.0.1 d5nxst8fruw4z.cloudfront.net 127.0.0.1 b.scorecardresearch.com 127.0.0.1 advice-ads-cdn.vice.com 127.0.0.1 vice-publishers-cdn.vice.com 127.0.0.1 vice-sundry-assets-cdn.vice.com eof Alternatively, sed script below will give you just the article html, images, and embedded youtube along with all the json data enclosed in <pre></pre> tags. curl https://motherboard.vice.com/en_us/article/this-robot-is-livestreaming-all-the-gnarly-stuff-its-seeing-in-the-deep-sea?utm_source=mbtwitter \ |sed ' /window.__PREFETCH_DATA/!d; s/window.__PREFETCH_DATA = //; s/\"[:,]\"/\ /g; s/,\"/\ /g; s/\":/\ /g; s/.[}{]./\ /g; s/[}{]./\ /g; s/[][]//g; s/id/<pre>&/; s/body/&<\/pre>/; s/\\u003C/</g; s/\\u003E/>/g; s/\\u002F/\//g; s/\\"/\"/g; s/url/<pre>&/; s/embed_code/&<\/pre>/; s/autoplay/<pre>&/; s/;/<\/pre>/28; '
- pavel_lishin 10y ago
  Something like that sed script would be nice to pipe all of my browsing through, before it ever hits Chrome.
  - 10165 10y ago
    If you are serious and you want a script like this for any given page that you want de-crufted and reformatted, let me know. This applies to any HN reader. I make these for myself all the time. I do one-offs in sed and if it is something I will reuse I redo it in C using flex. If you want something generalized to all web pages that removes google analytics, doubleclick, scorecardresearch, etc. of course that is possible too. I am happy to make this for anyone who wants it. Another solution is to run a proxy on your computer that filters out garbage. Such proxies used to be more popular when advertising began to take over the web, but most of these projects seem to have been abandoned and forgotten (junkbusters, etc.). Nowadays it seems like people try to accomplish this via Javascript running in the browser. Turning off Javascript is also highly effective at disabling advertising. But note this may not stop things like img src tags pointing at tracking pixels, malicious iframes, and other elements that graphical browsers will load automatically. Also, tcp clients do not normally store or send cookies. And even if they try to provide this functionality, e.g., curl or wget, unlike a graphical web browser, cookies are off by default. Consider the case where the user retrieves the page with a tcp client and then views it in a browser.
    - milcron 10y ago
      >Nowadays it seems like people try to accomplish this via Javascript running in the browser. I filter out lots of cruft by doing the opposite - using NoScript to block extraneous junk.
    - j_s 10y ago
      λmegous | https://news.ycombinator.com/item?id=13226170 https://news.ycombinator.com/item?id=13226170 For each use case that is not a free browsing I create an electron app, that never executes any code from the web or uses any external style. It only uses XHR to fetch html pages/json data/other static stuff and then transforms that data and uses it in the custom UI designed for the use case.

Wow... that Motherboard web page is packed with enough cruft to bring my brand new Kaby Lake i5 to its knees.

jackyinger 10y ago

Yeah, that's why I don't read vice sites anymore...

shrimp_emoji 10y ago

What web page? https://snag.gy/skEJYT.jpg https://snag.gy/skEJYT.jpg

turbohedgehog 10y ago
What picture? http://i.imgur.com/srEiiD7.png http://i.imgur.com/srEiiD7.png

agumonkey 10y ago

Lucky for you next generation will accelerate internet. Save your money.

10165 10y ago

Assuming nothing listening on 127.0.0.1, this should fix the problem. cat << eof >> /etc/hosts 127.0.0.1 vice-web-statics-cdn.vice.com 127.0.0.1 fonts.googleapis.com 127.0.0.1 www.google-analytics.com 127.0.0.1 d31qbv1cthcecs.cloudfront.net 127.0.0.1 d5nxst8fruw4z.cloudfront.net 127.0.0.1 b.scorecardresearch.com 127.0.0.1 advice-ads-cdn.vice.com 127.0.0.1 vice-publishers-cdn.vice.com 127.0.0.1 vice-sundry-assets-cdn.vice.com eof Alternatively, sed script below will give you just the article html, images, and embedded youtube along with all the json data enclosed in <pre></pre> tags. curl https://motherboard.vice.com/en_us/article/this-robot-is-livestreaming-all-the-gnarly-stuff-its-seeing-in-the-deep-sea?utm_source=mbtwitter \ |sed ' /window.__PREFETCH_DATA/!d; s/window.__PREFETCH_DATA = //; s/\"[:,]\"/\ /g; s/,\"/\ /g; s/\":/\ /g; s/.[}{]./\ /g; s/[}{]./\ /g; s/[][]//g; s/id/<pre>&/; s/body/&<\/pre>/; s/\\u003C/</g; s/\\u003E/>/g; s/\\u002F/\//g; s/\\"/\"/g; s/url/<pre>&/; s/embed_code/&<\/pre>/; s/autoplay/<pre>&/; s/;/<\/pre>/28; '

pavel_lishin 10y ago
Something like that sed script would be nice to pipe all of my browsing through, before it ever hits Chrome.
- 10165 10y ago
  If you are serious and you want a script like this for any given page that you want de-crufted and reformatted, let me know. This applies to any HN reader. I make these for myself all the time. I do one-offs in sed and if it is something I will reuse I redo it in C using flex. If you want something generalized to all web pages that removes google analytics, doubleclick, scorecardresearch, etc. of course that is possible too. I am happy to make this for anyone who wants it. Another solution is to run a proxy on your computer that filters out garbage. Such proxies used to be more popular when advertising began to take over the web, but most of these projects seem to have been abandoned and forgotten (junkbusters, etc.). Nowadays it seems like people try to accomplish this via Javascript running in the browser. Turning off Javascript is also highly effective at disabling advertising. But note this may not stop things like img src tags pointing at tracking pixels, malicious iframes, and other elements that graphical browsers will load automatically. Also, tcp clients do not normally store or send cookies. And even if they try to provide this functionality, e.g., curl or wget, unlike a graphical web browser, cookies are off by default. Consider the case where the user retrieves the page with a tcp client and then views it in a browser.
  - milcron 10y ago
    >Nowadays it seems like people try to accomplish this via Javascript running in the browser. I filter out lots of cruft by doing the opposite - using NoScript to block extraneous junk.
  - j_s 10y ago
    λmegous | https://news.ycombinator.com/item?id=13226170 https://news.ycombinator.com/item?id=13226170 For each use case that is not a free browsing I create an electron app, that never executes any code from the web or uses any external style. It only uses XHR to fetch html pages/json data/other static stuff and then transforms that data and uses it in the custom UI designed for the use case.