2 ms·
As far as I can tell, after months of fighting being DDoSed by Anthropic and OpenAI across 50+ sites - Cloudflare also allows what it considers "good bots" thro
by devmor 10d ago
As far as I can tell, after months of fighting being DDoSed by Anthropic and OpenAI across 50+ sites - Cloudflare also allows what it considers "good bots" through all of your bot blocking rules, with no option to turn this off unless you pay them money.
- RobotToaster 10d agoThe "good bots" also just happen to be from companies that pay cloudflare a lot of money, I imagine.
- actionfromafar 10d agoGoodness Tokens
- basilikum 10d agoHow did you dertmine it was those two companies? Also did you disallow them in robots.txt?
- devmor 10d agoNo, I definitely spent months fighting off bots across multiple hosts and never set up a robots.txt file anywhere nor did I look at the analytics dashboard on cloudflare.
- basilikum 10d agoI'm asking sincerely, how do you get to the conclusion that it's those two?
- devmor 10d agoTo that point, Cloudflare quite literally tells you the source of the bot traffic on your sites that use it as a WAF! And what percentage they are allowing through, despite you setting rules specifically to block them by name. It’s baffling.