2 ms·
It uses a different user agent, but yeah it still obeys robots.txt. https://platform.openai.com/docs/plugins/bot https://platform.openai.com/docs/plugins/bot
by simonw 3y ago
It uses a different user agent, but yeah it still obeys robots.txt.
https://platform.openai.com/docs/plugins/bot https://platform.openai.com/docs/plugins/bot
User-agent: ChatGPT-User
Disallow: /