4 ms·
>The general way LLMs work do not preserve content in it's original form: the ideas they contain are extracted and clustered statistically - as a Is the way LL
by simion314 3y ago
>The general way LLMs work do not preserve content in it's original form: the ideas they contain are extracted and clustered statistically - as a
Is the way LLM work relevant?
I can make a shitty script that has as input Microsoft proprietary code and as output something identical in purpose but the text is completely different, I would rename names with synonyms, swap some things around etc.
I am not against AIs, my opinion is that if your AI uses GPL code the output should be GPL, if it uses public domain images the output should be public domain images.
I mean for code if AI is actual intelligent you should be able to train an AI with C with just a few books and not with the entire GitHub open source code (and notice MS did not trained copilot on the proprietary code they have access proving they are not confident that they are in the right).
- sebzim4500 3y agoI don't think the process matters much, but your proposed script would output something that was obviously very similar to the original. What ChatGPT produces under normal use is not more similar to the NYT source than any other article on the same topic.
- simion314 3y ago>What ChatGPT produces under normal use is not more similar to the NYT source than any other article on the same topic. ChatGPT is doing what a smart student does when he copies the homework, he combines a few sources and changes some wording. Technically there is no creativity, it is interpolating it's inputs and there is some randomness thrown in. We also know that ChatGPT put some filters to filter out copyrighted outputs after they were caught that the AI actually memorizes paragraphs of text word by word.
- paulryanrogers 3y ago> my opinion is that if your AI uses GPL code the output should be GPL If I use Inkscape is the output of my drawing subject to the same terms as Inkscape? If I use a Photoshop filter is the output subject to Photoshop's EULA and/or the copyright of the photo I started with?
- simion314 3y agoIf I use a Photoshop filter is the output subject to Photoshop's EULA and/or the copyright of the photo I started with? If you get my image from the internet then you resize it in Photoshop you can't claim you created some original art, you just used the resize/crop/color filter function.
- paulryanrogers 3y agoIndeed. I was hoping to draw the distinction between license of the tool vs its output. AI is interesting in that its training inputs can leak out, sometimes in ways that are verbatim or insufficiently transformative to be free of copyright.
- simion314 3y agoBut do this exercise, imagine I have 1 billion lines of C code on GitHub under GPL. You train a new AI only on my GPL code then claim that the output is somehow trans formative and it is not GPL or it is not derived from my code but is new and original. What happens is that Microsoft or OpenAI will use 1000 or more different sources and then the author is not clear unless in few outputs where the tool outputs the exact code as the training data. If the AI is actual inteligent they could train it in a few books and say MDN documentation and not a few thousands of GPL code.