3 ms·
I would recommend grab-site instead if you’re archiving, but wget is easier if mirroring content. https://github.com/ArchiveTeam/grab-site https://github.com/A
by toomuchtodo 2y ago
I would recommend grab-site instead if you’re archiving, but wget is easier if mirroring content.
https://github.com/ArchiveTeam/grab-site https://github.com/ArchiveTeam/grab-site
- pogue 2y agoI'm wanting to archive a site but it requires a login. Can I do something like drop a cookie from another browser & drop it in the folder for this or is it more complicated? Unfortunately, it's not the clean/easy old user:login style login, but a form you have to fill out.
- wenzlawski 2y agoFor most browsers you can copy the reuquest in curl format to a site through the Network tab in the Developer Tools panel. In there should be all the cookies/user data required to make a request from the command line.
- belter 2y agograb-site or HTTrack are a better option for the modern documentation websites most will probably try to download. The wget suggestions advanced here or in the blog will only work for the most basic of the static sites, and will quickly fail for sites like for example Juniper, Cisco, AWS or Azure documentation.
- toomuchtodo 2y agoExcellent point. Some experimentation might be required for the optimal tool for site ripping, depending on presentation layer. If there is room for improvement in grab-site, please open a Github Issue.