4 ms·
Id be more curious on finding out what AI bots can access my site, so i could stop it. At the public disclosure of chatgpt i immediately went and added a block
by CableNinja 9mo ago
Id be more curious on finding out what AI bots can access my site, so i could stop it.
At the public disclosure of chatgpt i immediately went and added a block in my nginx config. I would ideally like to block them all.
Im currently relying on UA and have a tiny if statement in my config that tells every ai ive blocked my server is simply a teapot
- aggeeinn 9mo agoThe 418 status is a nice touch. We actually noticed that whack-a-mole issue across the entire dataset—keeping a static Nginx config synced with the explosion of new user-agents is proving difficult for most admins right now. If you're curious to stress-test the regex, feel free to drop the URL (or check my profile for email). I can run a quick pass with our crawler to see if it triggers the teapot response or if the headers manage to slip through.