3 ms·
honoring robots.txt is an informal courtesy, not international law.
by 123yawaworht456 2y ago
honoring robots.txt is an informal courtesy, not international law.
- davemp 2y agoNot breaking the law is just about the lowest bar you can set for an organization.
- not_a_bot_4sho 2y agoWe can go lower
- hnfong 2y agoFYI, we're still not sure whether the scraped AI training datasets involve copyright infringement.