4 ms·
> Chromium: Wayback uses a headless Chromium to capture web pages for archiving purposes. [0] I think it is a local spider. This quote is the only clear indica
by pastage 4y ago
> Chromium: Wayback uses a headless Chromium to capture web pages for archiving purposes. [0]
I think it is a local spider. This quote is the only clear indication that they actually spider themselves. There are lots of implicit statements as well.
[0] https://docs.wabarc.eu.org/installation/ https://docs.wabarc.eu.org/installation/
- wabarc 4y agoCorrect, wayback has implemented remote and local archiving of various types of resources, including HTML, PDF, HAR, WARC, Readability (Markdown and Txt), and media files such as images, videos, and audio.