4 ms·
Couple notes related to using the Wayback Machine to recover parts of the old blog: To list URLs for bulk downloading, you can also directly use the CDX or Mem
by mgdlbp 4y ago
Couple notes related to using the Wayback Machine to recover parts of the old blog:
To list URLs for bulk downloading, you can also directly use the CDX or Memento APIs, which are pretty simple and require no auth. Documentation here,[1][2] though the bulk of the CDX docs in the GitHub repo they link apparently haven't been updated since 2013.
[1] https://archive.org/help/wayback_api.php https://archive.org/help/wayback_api.php
[2] https://support.archive-it.org/hc/en-us/articles/115001790023-Access-Archive-It-s-Wayback-index-with-the-CDX-C-API https://support.archive-it.org/hc/en-us/articles/11500179002...
Appending if_ to the date part of an archive URL hides the Wayback Machine banner -- the URL format also supports other replay codes and approximate dates. The official docs[3] here are even more outdated; Wikipedia's guide[4] looks like the most complete but still leaves out codes like oe_ and mp_ (which no one seems to know the intended uses of).
[3] http://archive-access.sourceforge.net/projects/wayback/administrator_manual.html#Archival_URL_Replay_Mode http://archive-access.sourceforge.net/projects/wayback/admin...
[4] https://en.wikipedia.org/wiki/Help:Using_the_Wayback_Machine#URL_formats https://en.wikipedia.org/wiki/Help:Using_the_Wayback_Machine...
- simonw 4y agoThat if_ trick is fantastic, thanks! With banner: https://web.archive.org/web/20060316094837/http://scripts.incutio.com/xmlrpc/ https://web.archive.org/web/20060316094837/http://scripts.in... Without banner: https://web.archive.org/web/20060316094837if_/http://scripts.incutio.com/xmlrpc/ https://web.archive.org/web/20060316094837if_/http://scripts... Added a note about that to the bottom of https://simonwillison.net/2022/Jun/12/twenty-years/#internet-archive-screenshots https://simonwillison.net/2022/Jun/12/twenty-years/#internet...