3 ms·
I believe that archive.is is whatever you've archived into it. If you pressed the button when looking at the paywall, that's what it will carry.
by thriftwy 3y ago
I believe that archive.is is whatever you've archived into it. If you pressed the button when looking at the paywall, that's what it will carry.
- mschuster91 3y agoNo, they run their own crawler against the URL you provide (IIRC, it's a headless Google Chrome [1]). For some special / often-requested (?) sites the people behind the project have: - implemented post-processing to strip ads and tracker beacons - bought legitimate accounts that they use to bypass paywalls (some of them show up as remnants in the archived pages' code, some of them show up when you request an archive of the site's account management portal, some show up as HTTP traces during the archival process - the crawler will dump every URL it requests on a "WIP" page, and for some, auth information like JWTs is passed in the URL) - implemented anti-nagwall features (some sites are "vulnerable" in their paywall/"you read X articles, end of free limit" by pressing the ESC key to disrupt the JS of the site) [1] https://blog.archive.today/post/618635148292964352/what-scraper-or-headless-browser-are-you-using-it https://blog.archive.today/post/618635148292964352/what-scra...