3 ms·
What if there could be a robot.txt kind of setting that users could use to prevent being scraped?
by kovek 7y ago
What if there could be a robot.txt kind of setting that users could use to prevent being scraped?
- jakeogh 7y agoPointless unless you want a one world governement to enforce a law monoculture.