4 ms·

Yeah, you could patch seesaw-kit to not delete local data. Note that greader-grab just gets a random work item from the tracker. There's an ISO spec for WARC

by ivank 13y ago

Yeah, you could patch seesaw-kit to not delete local data. Note that greader-grab just gets a random work item from the tracker. There's an ISO spec for WARC and tools linked at http://www.archiveteam.org/index.php?title=The_WARC_Ecosystem http://www.archiveteam.org/index.php?title=The_WARC_Ecosyste...

subsystem 13y ago
I haven't tried it, but the --keep-data option might work? https://github.com/ArchiveTeam/seesaw-kit/blob/master/run-pipeline#L48 https://github.com/ArchiveTeam/seesaw-kit/blob/master/run-pi...
- ivank 13y ago
  Yeah, that looks like the right thing.