23 ms·Some scrapers respect robots.txt. OpenAI doesn't. SP is just informing the world at large of this fact.by jeremyjh 3y agoSome scrapers respect robots.txt. OpenAI doesn't. SP is just informing the world at large of this fact.