The web archiving community is surprisingly small and fragmented (in terms of tools) given its impact. Thankfully the .warc format looks pretty powerful and st

The web archiving community is surprisingly small and fragmented (in terms of tools) given its impact. Thankfully the .warc format looks pretty powerful and standard for the web we have so far (which is a lot! ). Now with the new protocols, dunno maybe its too soon to worry? Then again, maybe its an IPv4 / IPv6 analogy. > There is a companion format, CDX, which builds indexes from warc files (which in turn are just concatenated records, so rather robust). Good point. I's planning of combining this fact with the ATTACH option that SQLite has - allowing to query multiple database files [0] [0] https://www.sqlite.org/lang_attach.html https://www.sqlite.org/lang_attach.html