2 ms·

> Except the first thing openai does is read robots.txt. What good is reading it if it doesn't respect it