3 ms·

Sorry for the link, it seems like archive.is is no longer able to bypass the paywall for the WSJ.

• thriftwy 3y ago
  I believe that archive.is is whatever you've archived into it. If you pressed the button when looking at the paywall, that's what it will carry.
  • mschuster91 3y ago
    No, they run their own crawler against the URL you provide (IIRC, it's a headless Google Chrome [1]). For some special / often-requested (?) sites the people behind the project have: - implemented post-processing to strip ads and tracker beacons - bought legitimate accounts that they use to bypass paywalls (some of them show up as remnants in the archived pages' code, some of them show up when you request an archive of the site's account management portal, some show up as HTTP traces during the archival process - the crawler will dump every URL it requests on a "WIP" page, and for some, auth information like JWTs is passed in the URL) - implemented anti-nagwall features (some sites are "vulnerable" in their paywall/"you read X articles, end of free limit" by pressing the ESC key to disrupt the JS of the site) [1] https://blog.archive.today/post/618635148292964352/what-scraper-or-headless-browser-are-you-using-it https://blog.archive.today/post/618635148292964352/what-scra...
• top_sigrid 3y ago
  This one is working: https://archive.ph/WYdVW https://archive.ph/WYdVW
  • impish9208 3y ago
    Thanks!