4 ms·OpenAI uses the common crawl dataset and I would expect them to respect the robots.txt rules.by speedgoose 4y agoOpenAI uses the common crawl dataset and I would expect them to respect the robots.txt rules.