3 ms·
You can block OpenAI, but you should really be blocking all bots and bad actors who may be scraping your site, scanning for vulns, or the new kid in town: using
by sysadm1n 3y ago
You can block OpenAI, but you should really be blocking all bots and bad actors who may be scraping your site, scanning for vulns, or the new kid in town: using your site as training data. Robots.txt is not enough, and whilst the major players (Google, Bing etc) honor robots.txt, it can be completely ignored by other actors.
- tikkun 3y agoHow to? Is there an easy thing with cloudflare or similar and what’s the pricing
- 7moritz7 3y agoJust turn on Bot Fight Mode, that should be sufficient. If you have a very high risk scenario permanently turn on the under attack mode and it will throw a Turnstil captcha at all suspicious requests. In that scenario you should probably set up a WAF rule to block all Tor requests too (it's under the "country" selector).