6 ms·

Ridiculous. The copyright violation is in its use for training data. And then its doubled down by the user asking for copyrighted material and getting it verba

Ridiculous. The copyright violation is in its use for training data. And then its doubled down by the user asking for copyrighted material and getting it verbatim. It's not complicated. It's only complicated because it might be in the way of some people making billions or trillions. Let's stop with the analogies. Analogies won't get you anywhere. - if you recorded a concert with a tape recorder, then distributed it online for money, that was a copyright violation. - if you recorded a CD with a tape recorder, then sold copies, that was a copyright violation. - If you used a camera to film a movie being shown in a theatre, then distributed it online, that is a copyright violation. Stop the BS.

ben_w 2y ago
> The copyright violation is in its use for training data. Every textbook, every educational TV show or YouTube video, every artist whose works have been shown to me in my school lessons in art, music, graphic design, usw. have all been copyrighted. With one exception: Shakespeare. Even the bible, being a translation*, had copyright notices on it. But worse than that: if it were so even for scraping the whole web and training an AI on it… what do you think Google is? Page Rank is a big ol' matrix multiplication, and it spits out quotes verbatim. > It's not complicated. It's only complicated as it might be in the way of some people making billions. You know some of these LLMs can be downloaded and run locally, right? For free, even. "Not making money" is absolutely not sufficient to remove a claim of copyright infringement; and conversely these models are too useful to be simply ignored — they're now in the realm of national strategic thinking. > Let's stop with the analogies. Analogies won't get you anywhere. They are the only thing we have, as this didn't exist before, and we need to create a new legal framework for them. Even copyright itself as a legal idea comes from analogies starting at least as far back as a 6th century Irish dispute where King Diarmait Mac Cerbhaill gave the judgement "To every cow belongs her calf, therefore to every book belongs its copy."** > Also, if you recorded a concert with a tape recorder, then distributed it online for money, pretty sure that was a copyright violation. Yes, that's the point. And yet I am not forbidden from being online due to the fact that I have the capability to do so. Only the actual performance of this is an offence, not the mere capability. * All translation is necessarily also interpretation, specifically this one: https://en.wikipedia.org/wiki/Good_News_Bible https://en.wikipedia.org/wiki/Good_News_Bible ** Or at least that's the modern English translation of what he said, presumably either in in pre-medieval Latin or Old Irish.
- kranke155 2y ago
  I agree that copyright law is woefully unprepared, and that LLMs have become useful enough it will be difficult if not impossible to stop their development. > Page Rank is a big ol' matrix multiplication, and it spits out quotes verbatim. That makes no sense. Google Books was blocked exactly because it was reproducing enough material to be infringing. Google search usually does not copy enough material that it might be considered infringing (even though I think news sites have sued over this in some jurisdictions, right?) > And yet I am not forbidden from being online due to the fact that I have the capability to do so. It's fairly obvious that the people running LLMs don't want to prevent them from infringing copyright, particularly in image gen.
  - polotics 2y ago
    I disagree: I think copyright law is wholly prepared. If some thing produces a copy of copyrighted material, without explicit approval of the copyright owner, then it is infringing on the copyright. Where is the unprepared?
    - kranke155 2y ago
      It's unprepared for the fact that you can now build thinking machines using these new techniques, and that governments will be reluctant to regulate them if they think it will give them issues in an AI race against strategic opponents. Of course it's doubtful that image and video gen AI are strategically important, but I trust the AI lobby to make sure that governments won't make that distinction.
      - polotics 2y ago
        You wrote "thinking machines"? seriously? You do know that attention is all you need, right? (https://en.wikipedia.org/wiki/Attention_Is_All_You_Need https://en.wikipedia.org/wiki/Attention_Is_All_You_Need) Having a Generative Pretrained Transformer regurgitate pattern-matched input into mostly logical-appearing output does not make a thinking machine! (https://en.wikipedia.org/wiki/Generative_pre-trained_transformer https://en.wikipedia.org/wiki/Generative_pre-trained_transfo...) case in point, look at this, and think: """ It's true that relying solely on attention mechanisms, while groundbreaking, doesn't equate to genuine thinking. These models, impressive as they are, essentially excel at sophisticated mimicry. They learn to identify patterns in vast amounts of data and reproduce them in a way that often seems intelligent. However, they lack true understanding, consciousness, or the ability to form original thoughts and intentions. The danger lies in anthropomorphizing these systems. We marvel at their ability to generate human-like text, translate languages, and even write different kinds of creative content, and we may be tempted to ascribe human-like qualities to them. But it's crucial to remember that beneath the surface lies a complex algorithm, not a conscious mind. While the "Attention is All You Need" paper revolutionized the field of natural language processing, it's important to maintain a critical perspective and acknowledge the limitations of current AI technology. The quest for true artificial intelligence, a machine capable of independent thought and understanding, remains an ongoing challenge. """ Maybe you were able to spot a pattern, no?
jpalawaga 2y ago
Well, copyright law has literally everything to do with reproducing content and has nothing to do with consumption of content. So I have to disagree. Copyright doesn’t stipulate the terms of your consumption of media. Sure, people can write licenses and whatnot, but that’s not copyright, that’s a license (for example, the TOS of NYT website may dictate your rights to scrape it) Copyright law is woefully under-prepared to deal with the challenges of llms. If someone has a photographic memory, it’s not illegal for them to read the book, it’s illegal for them to reproduce it. That’s essentially what we’re seeing with LLMs. In all of your examples, the illegal part is really the distribution so far as copyright is concerned.
- kranke155 2y ago
  So how do you suggest LLMs could prevent reproduction of copyrighted material, if they're doing so now.
  - jpalawaga 2y ago
    I think that’s a more interesting question. I’m not sure how to do it, but I think that finding a way to stop the reproduction of copyrighted content is probably the missing piece. If there was a monetary penalty for reproduction of copyright works (apply human laws to machine), then I bet these companies would quickly figure out how to fingerprint output and match it to source data before sending it to the user.
    - polotics 2y ago
      So I go into a cinema with my recording equipment, record the movie, step outside and start selling downloads, and when the cops come, I say: "I’m not sure how to do it, but I think that finding a way to stop the reproduction of copyrighted content is probably the missing piece." Really?
      - ben_w 2y ago
        That's not a close reading of the other comment. If LLMs were specially advertised as a way to get all the stuff you already love for free, it would be. They're not. What they are advertised as is a way to solve problems and create novel things. In this regard, LLMs are less of a copyright infringement issue than, e.g. Google News and Google Images both of which had to change because they were in law copyright infringements. This does not mean that LLMs or diffusion models must get a free pass or anything like that: these are a novel things that didn't previously exist, so while I was initially surprised by the legal cases against Stability and OpenAI due to the existence of Google search and that nobody seemed to care about GPT-3 or the original DALL•E, the arguments made against them are nevertheless interesting and worth caring about. I suspect LLMs are so useful the powers that be will just carve out a space for them; conversely I don't see that applying to image generation models, so I kinda expect them to be strictly limited to cases where the source data can be proven correctly licensed.

ben_w 2y ago

> The copyright violation is in its use for training data. Every textbook, every educational TV show or YouTube video, every artist whose works have been shown to me in my school lessons in art, music, graphic design, usw. have all been copyrighted. With one exception: Shakespeare. Even the bible, being a translation*, had copyright notices on it. But worse than that: if it were so even for scraping the whole web and training an AI on it… what do you think Google is? Page Rank is a big ol' matrix multiplication, and it spits out quotes verbatim. > It's not complicated. It's only complicated as it might be in the way of some people making billions. You know some of these LLMs can be downloaded and run locally, right? For free, even. "Not making money" is absolutely not sufficient to remove a claim of copyright infringement; and conversely these models are too useful to be simply ignored — they're now in the realm of national strategic thinking. > Let's stop with the analogies. Analogies won't get you anywhere. They are the only thing we have, as this didn't exist before, and we need to create a new legal framework for them. Even copyright itself as a legal idea comes from analogies starting at least as far back as a 6th century Irish dispute where King Diarmait Mac Cerbhaill gave the judgement "To every cow belongs her calf, therefore to every book belongs its copy."** > Also, if you recorded a concert with a tape recorder, then distributed it online for money, pretty sure that was a copyright violation. Yes, that's the point. And yet I am not forbidden from being online due to the fact that I have the capability to do so. Only the actual performance of this is an offence, not the mere capability. * All translation is necessarily also interpretation, specifically this one: https://en.wikipedia.org/wiki/Good_News_Bible https://en.wikipedia.org/wiki/Good_News_Bible ** Or at least that's the modern English translation of what he said, presumably either in in pre-medieval Latin or Old Irish.

kranke155 2y ago
I agree that copyright law is woefully unprepared, and that LLMs have become useful enough it will be difficult if not impossible to stop their development. > Page Rank is a big ol' matrix multiplication, and it spits out quotes verbatim. That makes no sense. Google Books was blocked exactly because it was reproducing enough material to be infringing. Google search usually does not copy enough material that it might be considered infringing (even though I think news sites have sued over this in some jurisdictions, right?) > And yet I am not forbidden from being online due to the fact that I have the capability to do so. It's fairly obvious that the people running LLMs don't want to prevent them from infringing copyright, particularly in image gen.
- polotics 2y ago
  I disagree: I think copyright law is wholly prepared. If some thing produces a copy of copyrighted material, without explicit approval of the copyright owner, then it is infringing on the copyright. Where is the unprepared?
  - kranke155 2y ago
    It's unprepared for the fact that you can now build thinking machines using these new techniques, and that governments will be reluctant to regulate them if they think it will give them issues in an AI race against strategic opponents. Of course it's doubtful that image and video gen AI are strategically important, but I trust the AI lobby to make sure that governments won't make that distinction.
    - polotics 2y ago
      You wrote "thinking machines"? seriously? You do know that attention is all you need, right? (https://en.wikipedia.org/wiki/Attention_Is_All_You_Need https://en.wikipedia.org/wiki/Attention_Is_All_You_Need) Having a Generative Pretrained Transformer regurgitate pattern-matched input into mostly logical-appearing output does not make a thinking machine! (https://en.wikipedia.org/wiki/Generative_pre-trained_transformer https://en.wikipedia.org/wiki/Generative_pre-trained_transfo...) case in point, look at this, and think: """ It's true that relying solely on attention mechanisms, while groundbreaking, doesn't equate to genuine thinking. These models, impressive as they are, essentially excel at sophisticated mimicry. They learn to identify patterns in vast amounts of data and reproduce them in a way that often seems intelligent. However, they lack true understanding, consciousness, or the ability to form original thoughts and intentions. The danger lies in anthropomorphizing these systems. We marvel at their ability to generate human-like text, translate languages, and even write different kinds of creative content, and we may be tempted to ascribe human-like qualities to them. But it's crucial to remember that beneath the surface lies a complex algorithm, not a conscious mind. While the "Attention is All You Need" paper revolutionized the field of natural language processing, it's important to maintain a critical perspective and acknowledge the limitations of current AI technology. The quest for true artificial intelligence, a machine capable of independent thought and understanding, remains an ongoing challenge. """ Maybe you were able to spot a pattern, no?

jpalawaga 2y ago

Well, copyright law has literally everything to do with reproducing content and has nothing to do with consumption of content. So I have to disagree. Copyright doesn’t stipulate the terms of your consumption of media. Sure, people can write licenses and whatnot, but that’s not copyright, that’s a license (for example, the TOS of NYT website may dictate your rights to scrape it) Copyright law is woefully under-prepared to deal with the challenges of llms. If someone has a photographic memory, it’s not illegal for them to read the book, it’s illegal for them to reproduce it. That’s essentially what we’re seeing with LLMs. In all of your examples, the illegal part is really the distribution so far as copyright is concerned.

kranke155 2y ago
So how do you suggest LLMs could prevent reproduction of copyrighted material, if they're doing so now.
- jpalawaga 2y ago
  I think that’s a more interesting question. I’m not sure how to do it, but I think that finding a way to stop the reproduction of copyrighted content is probably the missing piece. If there was a monetary penalty for reproduction of copyright works (apply human laws to machine), then I bet these companies would quickly figure out how to fingerprint output and match it to source data before sending it to the user.
  - polotics 2y ago
    So I go into a cinema with my recording equipment, record the movie, step outside and start selling downloads, and when the cops come, I say: "I’m not sure how to do it, but I think that finding a way to stop the reproduction of copyrighted content is probably the missing piece." Really?
    - ben_w 2y ago
      That's not a close reading of the other comment. If LLMs were specially advertised as a way to get all the stuff you already love for free, it would be. They're not. What they are advertised as is a way to solve problems and create novel things. In this regard, LLMs are less of a copyright infringement issue than, e.g. Google News and Google Images both of which had to change because they were in law copyright infringements. This does not mean that LLMs or diffusion models must get a free pass or anything like that: these are a novel things that didn't previously exist, so while I was initially surprised by the legal cases against Stability and OpenAI due to the existence of Google search and that nobody seemed to care about GPT-3 or the original DALL•E, the arguments made against them are nevertheless interesting and worth caring about. I suspect LLMs are so useful the powers that be will just carve out a space for them; conversely I don't see that applying to image generation models, so I kinda expect them to be strictly limited to cases where the source data can be proven correctly licensed.