2 ms·
What's the solution here? Metered usage based on network traffic that gets shared with the website owners? Otherwise everything moves behind a paywall?
by CSMastermind 1y ago
What's the solution here? Metered usage based on network traffic that gets shared with the website owners?
Otherwise everything moves behind a paywall?
- Analemma_ 1y agoFor now the solution is proof-of-work systems like Anubis combined with cookie-based rate limiting: you get throttled if your session cookie indicates you scraped here before, and if you throw the cookie out you get the POW challenge again. I don't know how long this will continue to work, but for my site at least it seems to be holding back the deluge, for the moment.
- the_snooze 1y ago>Otherwise everything moves behind a paywall? Basically. Paywalls and private services. Do things that are anti-scale, because things meant for consumption at scale will inevitably draw parasites.