3 ms·
An interesting thought are government or foreign actors training a generative Ai. They won't abide by any no-index tax and will scrape any and everything.
by TheCaptain4815 3y ago
An interesting thought are government or foreign actors training a generative Ai. They won't abide by any no-index tax and will scrape any and everything.
- JohnFen 3y agoIt doesn't have to be government or foreign actors. Abiding by the contents of robots.txt isn't required of anybody at all. It's merely a social convention.