4 ms·

There isn't one. As far as I know, no one really knows for sure how they bypass all these paywalls. (Most credible theory I heard: They actually just pay for th

by mr_mitm 8mo ago

There isn't one. As far as I know, no one really knows for sure how they bypass all these paywalls. (Most credible theory I heard: They actually just pay for the subscriptions.)

chrisjj 8mo ago
What's your problem with that theory?
- blenderob 8mo ago
  Has people's ability to read messages and formulate sensible replies been going down of late? I see this kind of meaningless replies more and more often these days.
  - direwolf20 8mo ago
    Yes, there's a global intelligence crisis, due to tiktok instagram et al
  - chrisjj 8mo ago
    Meaningless? Its a clear question.
    - PKop 8mo ago
      You're accusing him of having a problem with it, which his comment does not imply.
- mr_mitm 8mo ago
  None
wolvoleo 8mo ago
Most paywalls just allow search engines to read their content just fine. Because they do want discoverability, they want their cake and eat it. There's a few publications that don't even do that though and archive.is is very good at bypassing them so I do imagine they use logins for those, but for the masses of sites it's not currently necessary.
- direwolf20 8mo ago
  You can't impersonate Google. Sites check the source IP and they don't overlap with Google Cloud.
  - chrisjj 8mo ago
    You can for sites that can't afford the cost of keeping up-to-date with the Google IP list without which they can lose timely indexing. That is many.
    - otterley 8mo ago
      What do you mean by “afford the cost”? The list is free of charge (https://support.google.com/a/answer/10026322?hl=en-GB https://support.google.com/a/answer/10026322?hl=en-GB) and maintenance can be fully automated.
      - chrisjj 8mo ago
        I mean cost of server setup and execution.
        otterley 8mo ago
        The server that is providing the content exists already. That's a sunk cost.
        chrisjj 8mo ago
        "setup and execution".
        otterley 8mo ago
        What serious operator of a service isn't budgeting time to implement and operate critical maintenance functions?
otterley 8mo ago
Many sites including Bloomberg have evolved such that even archive.today don’t have the full text of any articles. They’re doing no giveaways whatsoever.
ebilgenius 8mo ago
Ghostarchive does a decent job for the same sites in my experience: https://ghostarchive.org/ https://ghostarchive.org/
- ebilgenius 8mo ago
  Update: hmm seems like they're involved in this whole thing too somehow, how strange: https://news.ycombinator.com/item?id=46629646 https://news.ycombinator.com/item?id=46629646
  - cpncrunch 8mo ago
    That comment is weirdly confusing/confused. But if you try archiving any site on ghostarchive, or clicking on any existing ghostarchive links, it just says "site is down for maintenance". For now I've given up on using any archiving sites until we can find a safe and reliable alternative.

by mr_mitm 8mo ago

There isn't one. As far as I know, no one really knows for sure how they bypass all these paywalls. (Most credible theory I heard: They actually just pay for the subscriptions.)

chrisjj 8mo ago

What's your problem with that theory?

blenderob 8mo ago
Has people's ability to read messages and formulate sensible replies been going down of late? I see this kind of meaningless replies more and more often these days.
- direwolf20 8mo ago
  Yes, there's a global intelligence crisis, due to tiktok instagram et al
- chrisjj 8mo ago
  Meaningless? Its a clear question.
  - PKop 8mo ago
    You're accusing him of having a problem with it, which his comment does not imply.
mr_mitm 8mo ago
None

wolvoleo 8mo ago

Most paywalls just allow search engines to read their content just fine. Because they do want discoverability, they want their cake and eat it. There's a few publications that don't even do that though and archive.is is very good at bypassing them so I do imagine they use logins for those, but for the masses of sites it's not currently necessary.

direwolf20 8mo ago
You can't impersonate Google. Sites check the source IP and they don't overlap with Google Cloud.
- chrisjj 8mo ago
  You can for sites that can't afford the cost of keeping up-to-date with the Google IP list without which they can lose timely indexing. That is many.
  - otterley 8mo ago
    What do you mean by “afford the cost”? The list is free of charge (https://support.google.com/a/answer/10026322?hl=en-GB https://support.google.com/a/answer/10026322?hl=en-GB) and maintenance can be fully automated.
    - chrisjj 8mo ago
      I mean cost of server setup and execution.
      - otterley 8mo ago
        The server that is providing the content exists already. That's a sunk cost.
        chrisjj 8mo ago
        "setup and execution".
        otterley 8mo ago
        What serious operator of a service isn't budgeting time to implement and operate critical maintenance functions?

otterley 8mo ago

Many sites including Bloomberg have evolved such that even archive.today don’t have the full text of any articles. They’re doing no giveaways whatsoever.

ebilgenius 8mo ago

Ghostarchive does a decent job for the same sites in my experience: https://ghostarchive.org/ https://ghostarchive.org/

ebilgenius 8mo ago
Update: hmm seems like they're involved in this whole thing too somehow, how strange: https://news.ycombinator.com/item?id=46629646 https://news.ycombinator.com/item?id=46629646
- cpncrunch 8mo ago
  That comment is weirdly confusing/confused. But if you try archiving any site on ghostarchive, or clicking on any existing ghostarchive links, it just says "site is down for maintenance". For now I've given up on using any archiving sites until we can find a safe and reliable alternative.