3 ms·

Same. I've been scraping PDF'ed magazines, etc. and keeping them locally. In addition to feeding my byte-hoarding tendencies, I like the idea I could be off-gri

Same. I've been scraping PDF'ed magazines, etc. and keeping them locally. In addition to feeding my byte-hoarding tendencies, I like the idea I could be off-grid in my van/RV somewhere and reading a "Popular Electronics" magazine from 1972 on my laptop. (Oh, never mind YouTube videos that I once added to playlists ... that later disappear leaving only holes in my playlists.)

jasonfarnon 2y ago
My problem with this approach is that the stuff I want to look at in 10 yrs time is never the stuff I think of saving right now. In the 2000s there were browser extensions I've forgotten the names of (shelf? slogger?) that would automatically save local copies of every webpage on page load. But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway.
- rightbyte 2y ago
  > But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway. It is probably easiest to save the render as a picture and then store text separately for searchability?
  - disqard 2y ago
    There's a way to get "the best of both worlds" (tbh, works most of the time): print to pdf.
- Intralexical 2y ago
  > But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway. Chromium's MHTML "Save as…" and the SingleFile WebExtension should both save copies of the rendered DOM. Apparently Safari has WebArchive and Mozilla had MAFF for similar use cases. I think WARC is supposed to save enough data about network streams for dynamic pages to work. At least on the Wayback Machine, infinite scrolling and "Load More" buttons do kinda work sometimes. You may have to load the archived pages in a browser and try to use each dynamic feature at least once, to trigger requests for needed resources. SingleFile: https://github.com/gildas-lormeau/SingleFile https://github.com/gildas-lormeau/SingleFile LWN on WARC, tools: https://anarc.at/blog/2018-10-04-archiving-web-sites/ https://anarc.at/blog/2018-10-04-archiving-web-sites/ Self-hostable web archives: https://awesome-selfhosted.net/tags/archiving-and-digital-preservation-dp.html https://awesome-selfhosted.net/tags/archiving-and-digital-pr... Wayback Machine addons, bookmarklets: https://help.archive.org/help/save-pages-in-the-wayback-machine/ https://help.archive.org/help/save-pages-in-the-wayback-mach...

jasonfarnon 2y ago

My problem with this approach is that the stuff I want to look at in 10 yrs time is never the stuff I think of saving right now. In the 2000s there were browser extensions I've forgotten the names of (shelf? slogger?) that would automatically save local copies of every webpage on page load. But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway.

rightbyte 2y ago
> But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway. It is probably easiest to save the render as a picture and then store text separately for searchability?
- disqard 2y ago
  There's a way to get "the best of both worlds" (tbh, works most of the time): print to pdf.
Intralexical 2y ago
> But I don't think they're around anymore and have no idea how you could achieve similar functionality with dynamic pages anyway. Chromium's MHTML "Save as…" and the SingleFile WebExtension should both save copies of the rendered DOM. Apparently Safari has WebArchive and Mozilla had MAFF for similar use cases. I think WARC is supposed to save enough data about network streams for dynamic pages to work. At least on the Wayback Machine, infinite scrolling and "Load More" buttons do kinda work sometimes. You may have to load the archived pages in a browser and try to use each dynamic feature at least once, to trigger requests for needed resources. SingleFile: https://github.com/gildas-lormeau/SingleFile https://github.com/gildas-lormeau/SingleFile LWN on WARC, tools: https://anarc.at/blog/2018-10-04-archiving-web-sites/ https://anarc.at/blog/2018-10-04-archiving-web-sites/ Self-hostable web archives: https://awesome-selfhosted.net/tags/archiving-and-digital-preservation-dp.html https://awesome-selfhosted.net/tags/archiving-and-digital-pr... Wayback Machine addons, bookmarklets: https://help.archive.org/help/save-pages-in-the-wayback-machine/ https://help.archive.org/help/save-pages-in-the-wayback-mach...