4 ms·

"This page is taking too long to load" on sites with anti-scraper technology. Do Not Want.

by Animats 1y ago

Unmixed0039 1y ago
[flagged]
- RamRodification 1y ago
  No, but it also doesn't matter whose fault it is. Having that happen will probably reduce your traffic. It might be worth the trade-off, and it might not. But if people go "Do Not Want!" it is worth paying attention to.
  - alpaca128 1y ago
    The one mentioned in the article was made because LLM scrapers DDOSed a person’s server. If it’s unusable for everyone, making everyone wait a bit to solve the issue is a clear improvement. > it also doesn’t matter whose fault it is People will always blame someone and have the uncanny talent to blame the wrong party. With cookie popups they blame the EU instead of the websites literally selling them out, here they’ll probably turn around and blame the website operators for defending themselves. For corporations running not just the scrapers but also the social networks it’s easy to algorithmically control the narrative.
    - RamRodification 1y ago
      > If it’s unusable for everyone, making everyone wait a bit to solve the issue is a clear improvement. I agree. > People will always blame someone I agree. That's my point.
    - ReptileMan 1y ago
      >With cookie popups they blame the EU instead of the websites literally selling them out EU created the flawed legislation, EU carved the loopholes, EU implementation and enforcement sucked, sites took the most obvious and predictable road. So who is to blame for the worse experience?
  - Disposal8433 1y ago
    > will probably reduce your traffic That's the point. Some web sites are DDOSed by scrapers and they obviously don't want such traffic.
    - RamRodification 1y ago
      I meant 'real' traffic. Maybe that wasn't obvious.
jchw 1y ago
In general if you're coming from a "clean" IP your difficulty won't be very high. In the future if these systems coordinate with each other in some way (DHT?) then it should make it possible to drop the baseline difficulty even further.
- berkes 1y ago
  That's a perfect tool for monopolists to widen their moat even more. In line with how email is technically still federated and distributed, but practically oligopolized by a handfull of big-tech, through "fighting spam".
- account42 1y ago
  > In general if you're coming from a "clean" IP your difficulty won't be very high. Unless you are using an operating system or browser that isn't the monopoly choice. Fuck off with this idea that some clients are better than others.
  - jchw 1y ago
    That has absolutely fuck all to do with IP reputation, you're mixing up unrelated concepts.

"This page is taking too long to load" on sites with anti-scraper technology. Do Not Want.

Unmixed0039 1y ago

[flagged]

RamRodification 1y ago
No, but it also doesn't matter whose fault it is. Having that happen will probably reduce your traffic. It might be worth the trade-off, and it might not. But if people go "Do Not Want!" it is worth paying attention to.
- alpaca128 1y ago
  The one mentioned in the article was made because LLM scrapers DDOSed a person’s server. If it’s unusable for everyone, making everyone wait a bit to solve the issue is a clear improvement. > it also doesn’t matter whose fault it is People will always blame someone and have the uncanny talent to blame the wrong party. With cookie popups they blame the EU instead of the websites literally selling them out, here they’ll probably turn around and blame the website operators for defending themselves. For corporations running not just the scrapers but also the social networks it’s easy to algorithmically control the narrative.
  - RamRodification 1y ago
    > If it’s unusable for everyone, making everyone wait a bit to solve the issue is a clear improvement. I agree. > People will always blame someone I agree. That's my point.
  - ReptileMan 1y ago
    >With cookie popups they blame the EU instead of the websites literally selling them out EU created the flawed legislation, EU carved the loopholes, EU implementation and enforcement sucked, sites took the most obvious and predictable road. So who is to blame for the worse experience?
- Disposal8433 1y ago
  > will probably reduce your traffic That's the point. Some web sites are DDOSed by scrapers and they obviously don't want such traffic.
  - RamRodification 1y ago
    I meant 'real' traffic. Maybe that wasn't obvious.

jchw 1y ago

In general if you're coming from a "clean" IP your difficulty won't be very high. In the future if these systems coordinate with each other in some way (DHT?) then it should make it possible to drop the baseline difficulty even further.

berkes 1y ago
That's a perfect tool for monopolists to widen their moat even more. In line with how email is technically still federated and distributed, but practically oligopolized by a handfull of big-tech, through "fighting spam".
account42 1y ago
> In general if you're coming from a "clean" IP your difficulty won't be very high. Unless you are using an operating system or browser that isn't the monopoly choice. Fuck off with this idea that some clients are better than others.
- jchw 1y ago
  That has absolutely fuck all to do with IP reputation, you're mixing up unrelated concepts.