5 ms·

If they screw it up then I'll personally host some service that scrapes all the text and only dumps a few kbs to you :)

• thanksforfish 6y ago
  Honestly theres a lot of other sites that would benefit from that too. A well written and maintained scraper for a bunch of popular sites may be worth a subscription for some bandwidth limited people.
  • 0x38B 6y ago
    I've thought about this, too; some of my favorite sites are forums that are a pain to use on mobile (e.g. RuTracker). Seems like a fun project, so I may start planning it when I have time.
    • williamdclt 6y ago
      Be careful with that: it very probably goes against all sorts of TOS and can get you in trouble
      • cddotdotslash 6y ago
        A court recently ruled [1] that LinkedIn had to allow scraping, but it has to be public data (i.e. you can't log into your Facebook account and then scrape all your friends' pages). [1] https://www.eff.org/deeplinks/2019/09/victory-ruling-hiq-v-linkedin-protects-scraping-public-data https://www.eff.org/deeplinks/2019/09/victory-ruling-hiq-v-l...
        • williamdclt 6y ago
          It's not the scraping itself that I would be worried about, it's using this data to create what could be seen as a competitor (especially if you make it commercial). For a lot of these websites, traffic is essentially money: diverting users to another website using their own content would be very badly received
      • 0x38B 6y ago
        Thanks for the heads up. I was more thinking about a local web-app that consumes the site and then outputs it in a nice mobile layout, without actually archiving or saving anything.