4 ms·
> - spam, which now includes scrapers bringing your site to a crawl What do you mean with "now"? If you've ever been in a competitive industry before, you're a
by CaptainOfCoit 1y ago
> - spam, which now includes scrapers bringing your site to a crawl
What do you mean with "now"? If you've ever been in a competitive industry before, you're already used to the random DDoS, and if you've published a moderately successful website, you've dealt with misbehaving scrapers/user-agents too, like the ones that get stuck and get requesting random 100 URLs per second for weeks.
I'm guessing you're alluding to AI scrapers, but are they really that different from what we've already learnt to deal with on the public internet?