3 ms·
What archival tool were you using? I've been looking for a replacement for HTTRACK forever.
by causi 4y ago
What archival tool were you using? I've been looking for a replacement for HTTRACK forever.
- NelsonMinar 4y agoA combination of shotscraper and metascraper; really more web previews than archives. And in a single thread, to different hostnames, maybe one every 10 seconds? Honestly surprised Akamai or anything even noticed. I fake my user agent now, lesson learned.