4 ms·
Because AI scraping is everywhere and flooding sites with useless traffic. It’s not ideal, but it’s the best people can do atm
by tyre 10mo ago
Because AI scraping is everywhere and flooding sites with useless traffic. It’s not ideal, but it’s the best people can do atm
- embedding-shape 9mo agoWhat kind of blog gets flooded by what, 10/100 req/s at max? Seems somewhere along the line we forgot how to deploy and run infrastructure on the internet, if some basic scrapers manage to down your website.
- duskdozer 9mo agoI have a disconnect here too, which makes it feel like I'm missing something. I'm hit so often with very onerous captcha-like demands or just blocked entirely when trying to make a single page or login request. I understand restrictions for rate limiting and things, but at this rate it feels like it's only a matter of time before the whole web is behind voluntary ID-scan requests for "security" even if laws never come to pass.
- systemtest 9mo ago"It's not ideal" is an understatement, I have to do stupid captchas for about half my Google searches.