2 ms·
There were never 900k users interested in each commit. Never was, never will be. So that's a false comparison. These scrapers have upped both the server load (
by PaulDavisThe1st 1y ago
There were never 900k users interested in each commit. Never was, never will be. So that's a false comparison.
These scrapers have upped both the server load (requests per second) and bandwidth requirements, without me consenting to it. If they were actual human users OR bots that were appropriately designed to minimize their impact on the target sites, that's perfectly OK.
Maybe if this was truly the only way to get to our god-like LLM to work in a god-like way (*), it would also be acceptable. But it isn't.
And on top of that, they are incompetently designed and they are causing real issues that a huge number of sites need to address.
(*) put differently, if all this current scraping activity delivered some notable benefit to humanity