2 ms·
Depends on what you want to use your archive for. If it's just for opening it locally in a web browser, mirroring the content is enough.
by progval 8y ago
Depends on what you want to use your archive for. If it's just for opening it locally in a web browser, mirroring the content is enough.
- toomuchtodo 8y agoYes, but if the effort to go the WARC route is minimal above mirroring, might as well do it. You never know if you’ll need data you didn’t grab.
- nikisweeting 8y agoWe intend to store both the WARC of the headless broswer render and the wget clone. (I'm the creator @pirate on Github). The idea is to archive anything in many redundant formats (HTML clone, WARC, PDF, etc) and for people to run this on a deduplicated filesystem like ZFS/BTRFS or disable specific methods if they care about saving space. You can track the progress on implementing WARC saving for all archived resources here: https://github.com/pirate/ArchiveBox/issues/130 https://github.com/pirate/ArchiveBox/issues/130