3 ms·
The more ubiquitous format in modern times is Web ARChive (WARC[0]) format which is supported by tools like wget, Apache Nutch and organizations like Internet A
by capableweb 7y ago
The more ubiquitous format in modern times is Web ARChive (WARC[0]) format which is supported by tools like wget, Apache Nutch and organizations like Internet Archive and most national libraries[1]
WARC is also standarized by ISO and has a nice spec that's pretty easy to understand[2]
@gildas I saw there was a comparison table[3] but it seems to be missing WARC. Could you shed some light on why?
- [0] https://en.wikipedia.org/wiki/Web_ARChive https://en.wikipedia.org/wiki/Web_ARChive
- [1] http://digitalia.sbn.it/article/view/1473 http://digitalia.sbn.it/article/view/1473
- [2] https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/ https://iipc.github.io/warc-specifications/specifications/wa...
- [3] https://github.com/gildas-lormeau/SingleFile#file-format-comparison https://github.com/gildas-lormeau/SingleFile#file-format-com...
- gildas 7y agoI included in the table only formats that are at least supported natively in one modern browser. That's why the WARC format is missing. I'm not against adding it in the table though.
- capableweb 7y agoI see. Thanks for your reply! Yes, to open a WARC file you would need something like https://github.com/webrecorder/webrecorder-player https://github.com/webrecorder/webrecorder-player or another viewer[0] but the benefit is that you can now contribute to the webs archiving efforts and just upload the result directly to Internet Archive! With that said, I do understand your motivation. - [0] https://www.archiveteam.org/index.php?title=The_WARC_Ecosystem#WARC_viewer https://www.archiveteam.org/index.php?title=The_WARC_Ecosyst...
- BiteCode_dev 7y agoApparently there is an extension: https://addons.mozilla.org/en-US/firefox/addon/page-archive-viewer/ https://addons.mozilla.org/en-US/firefox/addon/page-archive-...