4 ms·
There is no law that says you have to respect robots.txt. It's just a suggestion.
by SeanAnderson 1y ago
There is no law that says you have to respect robots.txt. It's just a suggestion.
- scoofy 1y agoFor the websites that ChatGPT wants to scrape -- Reddit immediately comes to mind -- it's not an issue of law, it's an issue of "the infrastructure now exists to prevent you from doing that."