As I've discovered in the past few weeks of archiving a soon-to-be offline service: archiving is tricky and often requires tampering with traffic. The IA uses

As I've discovered in the past few weeks of archiving a soon-to-be offline service: archiving is tricky and often requires tampering with traffic. The IA uses a MITM proxy [0] to produce WARC files from intercepted traffic. Another software suite for producing high-fidelity archives injects JS [1] into pages served by its MITM proxy. [0] https://github.com/internetarchive/warcprox https://github.com/internetarchive/warcprox [1] https://github.com/webrecorder/wombat https://github.com/webrecorder/wombat