4 ms·
wget is ludicrously good for mirroring. I use it to mirror the entirety of EDGAR. For my money another tool that belongs in the toolbox is perl's WWW::Mechani
by thrownaway2424 11y ago
wget is ludicrously good for mirroring. I use it to mirror the entirety of EDGAR.
For my money another tool that belongs in the toolbox is perl's WWW::Mechanize and its component WWW::Mechanize::Shell.
- iglookid 11y agoHow does wget compare with httrack for mirroring?
- timClicks 11y agoIt's somewhat hard to compare CLI vs GUI programs.. but in my experience, wget --mirror is simpler than HTTrack for simple tasks, which takes a little bit of mucking around to start downloading. HTTrack has a smaller learning curve for more complex situations though.