4 ms·
> The meta tag is the way No, it is not. Doing this with a meta tag suffers from the same fundamental problem as using a mechanism like robots.txt has: it depe
by JohnFen 3y ago
> The meta tag is the way
No, it is not. Doing this with a meta tag suffers from the same fundamental problem as using a mechanism like robots.txt has: it depends on the goodwill of the crawler to obey it. It depends on trust.
That trust is not justifiable when it comes to search engine crawlers and robots.txt, since plenty of crawlers ignore it. It's hard to see how LLM crawlers would be more trustworthy.
- ke88y 3y agoThey may not be more trustworthy, but if using content in training data is not fair use then you'll at least have a stronger legal case. I don't think meta tags are necessary, but including the meta tag and a copyright in the text makes it very hard for the LLM trainer to claim ignorance (not that this is a defense anyways, but again, it gives you a strictly stronger hand and the brazenness may impact damages.)
- JohnFen 3y agoMy personal IANAL assessment is that using content in this way does not, in fact, violate copyright law as long as that content is not emitted verbatim by the LLM. So I don't think that copyright law is helpful here unless/until new law is created to cover this use case. And there is no good technological solution, either. It's a very tough spot to be in. Right now, I've done the only thing that people who are concerned can do -- I've removed all of my content from the public web entirely. That's how it will be until a better solution presents itself.
- ke88y 3y agoI generally agree. Until the SD and Copilot cases are settled, there's a huge risk that training is Fair Use.