Either curl or wget will get you pretty far. Learn one of them well. They are basically equivalent. I use curl. For current web apps, there is an interactive a

Either curl or wget will get you pretty far. Learn one of them well. They are basically equivalent. I use curl. For current web apps, there is an interactive archiver written in Python, Web Recorder. It captures the full bi-directional traffic of a session. https://webrecorder.io/ https://webrecorder.io/ Web Recorder uses an internal Python library, pywb. That might be a good place to look. https://github.com/webrecorder/pywb https://github.com/webrecorder/pywb It looks like Selenium has done a lot of catching up on it's interface. I'd be curious how they compare now. Talk to librarians about archiving the web. They made Internet Archive and have a lot of experience.