4 ms·

DIY Web Archiving Zine

65 points by marvinborner 2y ago

barrettondricka 2y ago
Why does this feel more like an advertisement for Webrecorder[0] than an actual guide? Why add that privacy and big tech section at the end? Thanks for the list of features and buzzwords, but I couldn't figure out what all this tooling exactly does. Also, none of the links work. And Webrecorder doesn't have a Firefox extension, so don't even bother listing any of the "privacy" stuff. [0]: https://github.com/webrecorder/ https://github.com/webrecorder/
- RunningDroid 2y ago
  > And Webrecorder doesn't have a Firefox extension Webrecorder bug: https://github.com/webrecorder/archiveweb.page/issues/16 https://github.com/webrecorder/archiveweb.page/issues/16
- seltzered_ 2y ago
  Yeah, as someone who has actually done mass archiving (thousands of pages) I was disappointed with the mention only of webrecorder (nice effort, but not for everyone) and zero mention of projects like Archivebox ( https://Archivebox.io https://Archivebox.io ) or Singlefile ( https://github.com/gildas-lormeau/SingleFile/ https://github.com/gildas-lormeau/SingleFile/ )
agieocean 2y ago
Archive.org has a cli which is useful if you're interested in the subject of the title: https://archive.org/developers/internetarchive/cli.html https://archive.org/developers/internetarchive/cli.html
memalign 2y ago
Does anybody have tips or tools for archiving web apps? I find that Archivebox and archive.org often don’t capture a working web app, which is understandable because resources and scripts can be loaded dynamically. Maybe it’s not really solvable without manual work and auditing the web app’s code.
- barrettondricka 2y ago
  There is "SingleFile"[0][1] and a tool called "Monolith"[2]. Of course Ctrl+S works quite well too. [0]: https://addons.mozilla.org/en-US/firefox/addon/single-file/ https://addons.mozilla.org/en-US/firefox/addon/single-file/ [1]: https://addons.mozilla.org/en-US/firefox/addon/singlefilez/ https://addons.mozilla.org/en-US/firefox/addon/singlefilez/ [2]: https://github.com/Y2Z/monolith https://github.com/Y2Z/monolith They all have ShowHNs with (probably) many more alternatives in the comments.
pabs3 2y ago
Also see ArchiveTeam: https://archiveteam.org/ https://archiveteam.org/
wiederholen 2y ago
[dead]

65 points by marvinborner 2y ago

Why does this feel more like an advertisement for Webrecorder[0] than an actual guide? Why add that privacy and big tech section at the end? Thanks for the list of features and buzzwords, but I couldn't figure out what all this tooling exactly does. Also, none of the links work. And Webrecorder doesn't have a Firefox extension, so don't even bother listing any of the "privacy" stuff. [0]: https://github.com/webrecorder/ https://github.com/webrecorder/

RunningDroid 2y ago
> And Webrecorder doesn't have a Firefox extension Webrecorder bug: https://github.com/webrecorder/archiveweb.page/issues/16 https://github.com/webrecorder/archiveweb.page/issues/16
seltzered_ 2y ago
Yeah, as someone who has actually done mass archiving (thousands of pages) I was disappointed with the mention only of webrecorder (nice effort, but not for everyone) and zero mention of projects like Archivebox ( https://Archivebox.io https://Archivebox.io ) or Singlefile ( https://github.com/gildas-lormeau/SingleFile/ https://github.com/gildas-lormeau/SingleFile/ )

agieocean 2y ago

Archive.org has a cli which is useful if you're interested in the subject of the title: https://archive.org/developers/internetarchive/cli.html https://archive.org/developers/internetarchive/cli.html

memalign 2y ago

Does anybody have tips or tools for archiving web apps? I find that Archivebox and archive.org often don’t capture a working web app, which is understandable because resources and scripts can be loaded dynamically. Maybe it’s not really solvable without manual work and auditing the web app’s code.

barrettondricka 2y ago
There is "SingleFile"[0][1] and a tool called "Monolith"[2]. Of course Ctrl+S works quite well too. [0]: https://addons.mozilla.org/en-US/firefox/addon/single-file/ https://addons.mozilla.org/en-US/firefox/addon/single-file/ [1]: https://addons.mozilla.org/en-US/firefox/addon/singlefilez/ https://addons.mozilla.org/en-US/firefox/addon/singlefilez/ [2]: https://github.com/Y2Z/monolith https://github.com/Y2Z/monolith They all have ShowHNs with (probably) many more alternatives in the comments.

pabs3 2y ago

Also see ArchiveTeam: https://archiveteam.org/ https://archiveteam.org/

wiederholen 2y ago

[dead]