2 ms·
We already did. The format supports attaching related content, the scraped info, with the archive itself. So you get your data along with the means to generate
by Spivak 2y ago
We already did. The format supports attaching related content, the scraped info, with the archive itself. So you get your data along with the means to generate it yourself if you want something different.
https://en.m.wikipedia.org/wiki/WARC_(file_format) https://en.m.wikipedia.org/wiki/WARC_(file_format)