I've been meaning to set up some kind of basic crawl & archive system forever. Ideally I'd like to output something replayable and analyzable like a WARC or HAR

I've been meaning to set up some kind of basic crawl & archive system forever. Ideally I'd like to output something replayable and analyzable like a WARC or HAR, but also spit out a PDF, which I think chrome headless should be able to do. Right now I just print to file if I want to "save" something. But your write-up is very thorough, that is basically the situation. So much good unique content on youtube too which is almost impossible to properly archive due to size, my subscriptions alone would probably be over 1TB. I'd like to write a basic tool that would take a PDF, i.e. of a book, and output a directory of PDFs of snapshots of all web links in the book, to create basically a full reference snapshot for a given book that could be stored alongside the book. Not sure if it work well and result in a reasonable size.