3 ms·
How did you dertmine it was those two companies? Also did you disallow them in robots.txt?
by basilikum 10d ago
How did you dertmine it was those two companies? Also did you disallow them in robots.txt?
- devmor 10d agoNo, I definitely spent months fighting off bots across multiple hosts and never set up a robots.txt file anywhere nor did I look at the analytics dashboard on cloudflare.
- basilikum 10d agoI'm asking sincerely, how do you get to the conclusion that it's those two?
- devmor 10d agoTo that point, Cloudflare quite literally tells you the source of the bot traffic on your sites that use it as a WAF! And what percentage they are allowing through, despite you setting rules specifically to block them by name. It’s baffling.