3 ms·
Ask HN: What’s the best way to archive web sites?
What’s the preferred format for archiving static web pages composed of mostly text and graphics? I had been exporting some as PDFs on Safari, but now I’m wondering if for completeness I should save them in a more complete archive format via Chrome or a different browser.
- rcarmo 4y agoI personally use an instance of https://archivebox.io/ https://archivebox.io/ on my home NAS. It does all the saving and conversion for you (runs Chrome internally and saves to multiple formats) and it’s just a “docker run” away. Only thing that I wish it did much better is search. Right now it doesn’t do a good job of indexing full text content, but I’m hopeful that will change.
- trilinearnz 4y agoThis might not be what you want, but you can direct the Wayback Machine on the Internet Archive to explicitly remember specific URLs. More info here: https://help.archive.org/help/save-pages-in-the-wayback-machine/ https://help.archive.org/help/save-pages-in-the-wayback-mach...
- Apocryphon 4y agoI've used IA a lot, but it's not very good at preserving image assets.
- sp332 4y agoYou can direct wget to spider your site and save all the requests and responses to a single Web Archive format file called a WARC. https://wiki.archiveteam.org/index.php/Wget https://wiki.archiveteam.org/index.php/Wget
- mattpallissard 4y agoWith wget you can also download the files into a directory.[1]. Then you can just point your web-browser at the file path. 1. https://www.linuxjournal.com/content/downloading-entire-web-site-wget https://www.linuxjournal.com/content/downloading-entire-web-...
- altilunium 4y agoUse SinglePage https://chrome.google.com/webstore/detail/singlefile/mpiodijhokgodhhofbcjdecpffjipkle?hl=en https://chrome.google.com/webstore/detail/singlefile/mpiodij...
- phendrenad2 4y agoHTTrack was the gold standard for backing up sites awhile ago, and I'm guessing that it's still a very good option.
- prachisingh123 4y agoA website can be archived using a variety of methods. A single webpage may be easily saved to your hard drive, you can rely on a CMS backup, or you can utilize free internet archive tools like HTTrack and the Wayback Machine. However, using an automatic archiving system that records every update is the ideal approach to record a site.