44 ms·

> While generally I post my code under open source licenses to others can easily use it, learn from it, modify it, whatever they like, I do not like the idea th

by hiatus 2y ago

> While generally I post my code under open source licenses to others can easily use it, learn from it, modify it, whatever they like, I do not like the idea that large corporations are taking this same code and putting it into a black box that is a machine learning model. > Corporations stealing, or using work without permission, for their machine learning models has been a discussion for a long while at this point. In general, I side with the creators or artists having their work taken. I don't get it. How can corporations be stealing anything from an open source project? Further, it seems like several of the repos are based on other people's code. What code of the author's do they have reservations against training AI on?

kosma 2y ago
They use the code without respecting the license terms. Just because the code is out in the open doesn't mean you can use it however you wish.
lambdaxyzw 2y ago
>How can corporations be stealing anything from an open source project? The code is published using some license that allows some use cases and prohibits other. For example GPL is famous for being viral. Using it to teach a LLM that spits "unlicensed" code is basically laundering copyright.
- hiatus 2y ago
  Using it to train an LLM seems orthogonal to the output of the LLM. For instance, they could have their LLM include a link to the license. Merely training an LLM on the data does not seem to be against the spirit of GPL or Apache license.
  - slindsey 2y ago
    I've heard AI advocates talk about a "right to read" or "right to learn"; meaning that we have the right to read something and then internalize it and use it. Therefore, why shouldn't an AI have the same right? The difference to me seems to be that the AI has the ability to regurgitate it in whole. I can read a book, learn about the concepts, then use or repeat those concepts. The AI can do the same. But is it really "learning"? It may be just spewing out pieces of the content without any understanding. In which case it's a copyright violation, right?
    - barfbagginus 2y ago
      Let's assume that both humans and AI can produce statements that are new and useful, and can both produce statements that violate copyright. For example a human can operate an illegal a video tube website where they serve verbatim copies of copyrighted movies. I'll argue that's not enough reason to grant the AI the right to learn from copyrighted materials, because the right to learn is intimately wrapped up in human needs, while AI rights are focused on corporate and societal needs, which are currently being decided. The human right to learn You're a human and you need the right to learn from copyrighted material in order to not suffer Ignorance, in order to serve Society, because it's not feasible to charge you a rent for ideas you get from a book, and because it would cause suffering and indignity if we tried to charge you for your own thoughts. With an AI, it's less clear it needs the right to learn from copyrighted material, because it's not a person that can suffer, and because the scale of its usage of copyrighted materials - and its potential harm to copyright holders - is about 5 orders of magnitude greater than that of any single person, and is potentially greater than the collective impact of human learners. Let's lay out the reasoning: 1. No AI Suffering (yet). The AI doesn't suffer from ignorance and isn't (yet) a real person. So it needs no personal right to learn. 2. Potential Social Harm. AI could pose a much greater threat to copyright holders than the sum total of all human learners. We'll be weighing this potential in court, and it's currently not clear how the matter will be decided. Copyright holders could be awarded protections against corporations training AIs. 3. Ease Of Accounting. AIs and their training materials can be audited, unlike a human mind. So we have a technical means to restrict the AI's ability to learn from copyrighted materials. 4. No Harm in Accounting. Since the AI is not yet a person, and suffers no indignity or invasion of privacy from being audited, it's safe to audit and regulate the AI's training materials. In summary it's important to remember that human rights exist because humans need those rights to enjoy life in a dignified way as persons, and because those rights benefit Society. When we decide the question of AI rights, it's important to remember it's not a person, and any rights it has will be provided on the basis of societal benefit alone. It's not yet clear which AI rights will benefit Society here. It's quite possible that we will strengthen copyrights against unlicensed AI use, at least to some degree beyond the current "free-for-all".
  - mrweasel 2y ago
    Someone could easily create a such a license. Free to use and distribute, $10,000 per line used for AI model training. I'll very naively assume that Amazon, OpenAI, Google and others check licenses before feeding data to their models. I'll stop assuming that when one of these companies admit that they don't actually care and it's not profitable for them to respect licenses.
    - barfbagginus 2y ago
      To make that enforceable, it would be nice to prove the AI was trained on it. You might insert a "sleeper/activator" pair. The sleeper is a watermark that the AI will recall verbatim. To make it provide the sleeper, we give the AI a special activator prompt. Demonstrating that your public repo successfully poisoned the AI with a watermark could become a court admissible proof of unauthorized scraping.
  - carom 2y ago
    The LLM is quite literally a derivative work of GPL code. At the very least, there is an argument in such a case that the derivative function (the model weights) should conform to the same license.
  - barfbagginus 2y ago
    You need to do more than include a link to the license to comply. You need to include the entire source code needed to compile the derived system. For an LLM that would include: 1. Training data 2. Training code and metrics 3. Hyperparameter settings 4. Output weights Anything less is really just misinterpretation of the nature of open source's provision for studying, modifying, and recompiling the LLM Tldr; these companies MUST make the LLM into AGPL and provide all necessary codes as described above. Companies that refuse this will be raided by open source copyright trolls, if we're lucky and a little mischievous.
mikeocool 2y ago
It appears that most of OPs code is licensed under the MIT License -- if you take some MIT Licensed code, modify it, and re-publish it you can't just remove the license or the copyright notice from it. IANAL and this hasn't really been sorted out by the courts at all yet, but you could certainly make an argument that AI generating code based on what it has scraped is a derivative work. I am yet to see an AI bot that outputs licenses and copyright notices with it's generated code.
- barfbagginus 2y ago
  I would say that whether it is derivative or transformative depends on things like the context and content, the way it would if you used a human engineer. Was the AI/engineer prompted in a way designed to elicit a close derivative of Open Source work, or is the task context novel and focused on solving a unique problem? Is the resulting system close in design, architecture and specific snippets? Or is it very different? I've seen academic AI that writes science papers, quoting and citing Source papers. This is usually done by using RAG to locate papers and extract specific quotes. Now imagine a rag assisted open source coding system that can pull code from all over GitHub. It may vendor and modify a certain dependency. But it will also keep a copy of the original code's license, as requested by the license. If the AI eventually rewrites that dependency from scratch with a clean room implementation, then it can drop the license.
xeromal 2y ago
They are the owner. They can change their mind and decide something bothers them.
- hiatus 2y ago
  Not if you put something into the world with a specific license. You can of course relicense later on but that won't stop people from using the previous version.
  - xeromal 2y ago
    Of course that's their legal right and the letter of the law, but your question was why did OP get bothered that was was training models on it. It's easy to make that mistake and now I'm sure they will restrict their future code.

by hiatus 2y ago

kosma 2y ago

They use the code without respecting the license terms. Just because the code is out in the open doesn't mean you can use it however you wish.

lambdaxyzw 2y ago

>How can corporations be stealing anything from an open source project? The code is published using some license that allows some use cases and prohibits other. For example GPL is famous for being viral. Using it to teach a LLM that spits "unlicensed" code is basically laundering copyright.

hiatus 2y ago
Using it to train an LLM seems orthogonal to the output of the LLM. For instance, they could have their LLM include a link to the license. Merely training an LLM on the data does not seem to be against the spirit of GPL or Apache license.
- slindsey 2y ago
  I've heard AI advocates talk about a "right to read" or "right to learn"; meaning that we have the right to read something and then internalize it and use it. Therefore, why shouldn't an AI have the same right? The difference to me seems to be that the AI has the ability to regurgitate it in whole. I can read a book, learn about the concepts, then use or repeat those concepts. The AI can do the same. But is it really "learning"? It may be just spewing out pieces of the content without any understanding. In which case it's a copyright violation, right?
  - barfbagginus 2y ago
    Let's assume that both humans and AI can produce statements that are new and useful, and can both produce statements that violate copyright. For example a human can operate an illegal a video tube website where they serve verbatim copies of copyrighted movies. I'll argue that's not enough reason to grant the AI the right to learn from copyrighted materials, because the right to learn is intimately wrapped up in human needs, while AI rights are focused on corporate and societal needs, which are currently being decided. The human right to learn You're a human and you need the right to learn from copyrighted material in order to not suffer Ignorance, in order to serve Society, because it's not feasible to charge you a rent for ideas you get from a book, and because it would cause suffering and indignity if we tried to charge you for your own thoughts. With an AI, it's less clear it needs the right to learn from copyrighted material, because it's not a person that can suffer, and because the scale of its usage of copyrighted materials - and its potential harm to copyright holders - is about 5 orders of magnitude greater than that of any single person, and is potentially greater than the collective impact of human learners. Let's lay out the reasoning: 1. No AI Suffering (yet). The AI doesn't suffer from ignorance and isn't (yet) a real person. So it needs no personal right to learn. 2. Potential Social Harm. AI could pose a much greater threat to copyright holders than the sum total of all human learners. We'll be weighing this potential in court, and it's currently not clear how the matter will be decided. Copyright holders could be awarded protections against corporations training AIs. 3. Ease Of Accounting. AIs and their training materials can be audited, unlike a human mind. So we have a technical means to restrict the AI's ability to learn from copyrighted materials. 4. No Harm in Accounting. Since the AI is not yet a person, and suffers no indignity or invasion of privacy from being audited, it's safe to audit and regulate the AI's training materials. In summary it's important to remember that human rights exist because humans need those rights to enjoy life in a dignified way as persons, and because those rights benefit Society. When we decide the question of AI rights, it's important to remember it's not a person, and any rights it has will be provided on the basis of societal benefit alone. It's not yet clear which AI rights will benefit Society here. It's quite possible that we will strengthen copyrights against unlicensed AI use, at least to some degree beyond the current "free-for-all".
- mrweasel 2y ago
  Someone could easily create a such a license. Free to use and distribute, $10,000 per line used for AI model training. I'll very naively assume that Amazon, OpenAI, Google and others check licenses before feeding data to their models. I'll stop assuming that when one of these companies admit that they don't actually care and it's not profitable for them to respect licenses.
  - barfbagginus 2y ago
    To make that enforceable, it would be nice to prove the AI was trained on it. You might insert a "sleeper/activator" pair. The sleeper is a watermark that the AI will recall verbatim. To make it provide the sleeper, we give the AI a special activator prompt. Demonstrating that your public repo successfully poisoned the AI with a watermark could become a court admissible proof of unauthorized scraping.
- carom 2y ago
  The LLM is quite literally a derivative work of GPL code. At the very least, there is an argument in such a case that the derivative function (the model weights) should conform to the same license.
- barfbagginus 2y ago
  You need to do more than include a link to the license to comply. You need to include the entire source code needed to compile the derived system. For an LLM that would include: 1. Training data 2. Training code and metrics 3. Hyperparameter settings 4. Output weights Anything less is really just misinterpretation of the nature of open source's provision for studying, modifying, and recompiling the LLM Tldr; these companies MUST make the LLM into AGPL and provide all necessary codes as described above. Companies that refuse this will be raided by open source copyright trolls, if we're lucky and a little mischievous.

mikeocool 2y ago

It appears that most of OPs code is licensed under the MIT License -- if you take some MIT Licensed code, modify it, and re-publish it you can't just remove the license or the copyright notice from it. IANAL and this hasn't really been sorted out by the courts at all yet, but you could certainly make an argument that AI generating code based on what it has scraped is a derivative work. I am yet to see an AI bot that outputs licenses and copyright notices with it's generated code.

barfbagginus 2y ago
I would say that whether it is derivative or transformative depends on things like the context and content, the way it would if you used a human engineer. Was the AI/engineer prompted in a way designed to elicit a close derivative of Open Source work, or is the task context novel and focused on solving a unique problem? Is the resulting system close in design, architecture and specific snippets? Or is it very different? I've seen academic AI that writes science papers, quoting and citing Source papers. This is usually done by using RAG to locate papers and extract specific quotes. Now imagine a rag assisted open source coding system that can pull code from all over GitHub. It may vendor and modify a certain dependency. But it will also keep a copy of the original code's license, as requested by the license. If the AI eventually rewrites that dependency from scratch with a clean room implementation, then it can drop the license.

xeromal 2y ago

They are the owner. They can change their mind and decide something bothers them.

hiatus 2y ago
Not if you put something into the world with a specific license. You can of course relicense later on but that won't stop people from using the previous version.
- xeromal 2y ago
  Of course that's their legal right and the letter of the law, but your question was why did OP get bothered that was was training models on it. It's easy to make that mistake and now I'm sure they will restrict their future code.