3 ms·
it would be great to have a raw json file or something of this list so we can just start blocking the requests instead of using robots.txt. do they really respe
by scopeh 3y ago
it would be great to have a raw json file or something of this list so we can just start blocking the requests instead of using robots.txt. do they really respect it? probably not.
- SushiHippie 3y agoMost of these bots already publish their IP ranges, so it would be just a simple firewall rule. For chatgpt user: https://platform.openai.com/docs/plugins/bot https://platform.openai.com/docs/plugins/bot And for gtpbot: https://platform.openai.com/docs/gptbot https://platform.openai.com/docs/gptbot https://openai.com/gptbot.json https://openai.com/gptbot.json