4 ms·
This is actually quite interesting, as it's drawing a distinction between training material that can be accessed by anybody with a web browser (like anybody's b
by crazygringo 3y ago
This is actually quite interesting, as it's drawing a distinction between training material that can be accessed by anybody with a web browser (like anybody's blog), vs. training material that was "illegally-acquired... available in bulk via torrent systems."
I don't think there's any reason why this would be a relevant legal distinction in terms of distributing an LLM -- blog authors weren't giving consent either.
However, I do wonder if there's a legal issue here in using pirated torrents for training. Is there any legal basis for saying fair use permits distributing an LLM trained on copyrighted material, but you have to purchase all the content first to do so legally if it's only available for sale? E.g. training on a blog post is fine because it's freely accessible, but Sarah Silverman's book is not because it's never been made available for free, and you didn't pay for it?
Or do the courts not really care at all how something is made? If you quote a passage from a book in a freelance article you write, nobody ever asks if you purchased the book or can prove you borrowed it from a library or a friend -- versus if you pirated a digital copy.
- akira2501 3y agoI'm allowed to make private copies of copywritten works. I'm not allowed to redistribute them. To what extent this is redistribution is not clear. Is there much of difference between this model and a machine, like a VCR, that recreates the original work when I press a button?
- seanmcdirmid 3y agoThis would be like you intensely studying the copy written work and then writing things based on the knowledge you obtained from that. Except, we don't know if their is an exception for things learned by people vs. things learned by machines, or if the machines are not really learning but copying instead (or if learning is intrinsically a form of copying?).
- pbhjpbhj 3y agoIn the case of unreleased work, you writing about your knowledge of it is just proof that you obtained the work, which is proof that you committed a tort/trespass. Just like if you published a newspaper article with information you could only have acquired by hacking someone's phone. I'm not sure what a court would find against you, but it seems clear that there would be some way to couch that as a legal grievance.
- seanmcdirmid 3y agoHmm...if I get on the internet and download and read a paper from some website, am I liable if that paper was actually private if I had no clue it was obtained illegally? It seems to me that the distributor would be liable at that point, not the person who got it from the distributor (unless they knew they were stolen goods, then of course they are liable!). A search engine that indexes the internet might be equally liable at that point, although the DCMA gives them an out if they have a mechanism to remove pirated entries from their index on request. Could LLMs have the same out?
- velosol 3y agoThere's a sci-fi plot there: those with money can afford to pay the copyright cost for material they've learned and anything they produce results in royalties to the creators of everything they've learned. Those without means are cast out, perhaps some generating original thoughts in a way that breaks the system. I think I'm going to have to re-read the Unincorporated Man.
- seanmcdirmid 3y agoWe aren't so far away from that, and it is becoming cheap enough that you won't even need money anymore. Rather than bootleg movies, people will just ask computers to derive a new movie from multiple existing movies, and then...it is an original work?
- WheatMillington 3y agoIt's legal to make a copy of something you own, however it's not legal to make a copy of something illicitly acquired, whether or not there's distribution involved.
- balls187 3y agoCompanies ofc now circumvent that by selling you licenses, and not something you own.
- jes5199 3y agois there legal jargon for this distinction?
- Scoundreller 3y agoIt gets kinda dicey in jurisdictions that have media levy taxes. The uploader might be breaking the law but not the downloader that stores the copyrighted material on levy-paid media. I’ve heard inklings of this argument in Canada but can’t figure out what the current state of the art is: https://en.m.wikipedia.org/wiki/File_sharing_in_Canada https://en.m.wikipedia.org/wiki/File_sharing_in_Canada Then is a corporation’s internal use for the purpose of analysis considered “private use”? If there’s no redistribution/broadcasting, is it still non-commercial?
- postmodest 3y agoIs Game of Thrones a redistribution of Lord of the Rings?
- permo-w 3y agoI buy a book and give it to my child, they read the book and later write and sell a story influenced by said book. should that be a copyright infringement? how about they become a therapist and sell access to knowledge from copyrighted books? should that be an infringement? what if they sell access to lectures they've given including facts from said book(s) to millions of people? it's understandable that people feel threatened by these technologies, but to a great degree the work of a successful artist is to understand and meet the desires of an audience. LLMs and image generation tech do not do this. they simply streamline the production of course if you've worked for years to become a graphic designer you're going to be annoyed that an AI can do your job for you, but this is simply what happens when technology moves forward. no one today mourns the loss of scribes to the printing press. the artists in control of their own destiny - i.e. making their own creative decisions - will not, can not, be affected by these models, unless they refuse to adapt to the times
- krisoft 3y ago> understand and meet the desires of an audience. LLMs and image generation tech do not do this. For now? I wouldn’t be surprised if that becomes the next feature though.
- permo-w 3y agothat's already been a thing for years. long before LLMs and Stable Diffusion it's just the instagram/tiktok/youtube suggested content algorithms
- milemi 3y agoIf you found a way to have a million children who could grow up in one day your analogy would be more apt. In that case you and your children would rightly be considered a threat.
- permo-w 3y agodid you read to the third analogy?
- JamesBarney 3y agoThis is not definitely not redistribution any more than writing a blog post of a book you read is.
- pdonis 3y ago> Is there any legal basis for saying fair use permits distributing an LLM trained on copyrighted material, but you have to purchase all the content first to do so legally if it's only available for sale? My understanding (disclaimer: IANAL) is that in order to claim fair use, you have to be legally in possession of the work. If the work is only legally available for sale, then you must have legally purchased a copy, or been given it by someone who did so (for example, if you received it as a gift).
- danans 3y ago> you must have legally purchased a copy, or been given it by someone who did so (for example, if you received it as a gift). I am also NAL, but can I imagine it goes further than that. Just purchasing a copy doesn't let you create and sell (directly as content or indirectly via a service like a chatbot) derivative works that are substantially similar in style and voice to the original work. For example, an LLM 's response to the request: "Write a short story about a comical trip to the nail salon in the style of Sarah Silverman" ... IMO doesn't constitute fair use, because the intellectual property of the artist is their style even more than the content they produce. Their style, built from their lived human experience, is what generates their copyrighted content. Even more than the content, the artist's style should be protected. The fact that a technology exists that can convincingly mimic their style doesn't change that. One might then ask, well what about artists mimicking each others work? Well, any artist with a shred of integrity will credit their major influences. We should hold machines (and their creators) to an even tougher standard than we hold people when it comes to mimicry. A real person can be inspired and moved by another person's artistic work such that they mimic it. Inspiration means nothing to a machine.
- hayleox 3y agoThis is not how U.S. copyright law works. In order for something to eligible for copyright protection, it must be "fixed in a tangible medium of expression". Someone's exact words can be copyrighted, but their ideas or their style cannot be. https://www.law.cornell.edu/wex/fixed_in_a_tangible_medium_of_expression https://www.law.cornell.edu/wex/fixed_in_a_tangible_medium_o...
- deleted 3y ago[deleted]
- banana_feather 3y ago> Or do the courts not really care at all how something is made? One of the fair use factors, which until fairly recently was consistently held out as the most important fair use factor, is the effect on the commercial market for the original work. Accordingly, a court is more likely to find that something is fair use if there is effectively no commercial market for the original work, though the fact that something isn't actively being sold isn't dispositive (open source licenses have survived in appellate courts despite being free as in beer).
- itronitron 3y agoScarcity drives a lot of value for original work.
- jmkb 3y agoEventually, I imagine a new licensing concept will emerge, similar to the idea of music synchronization rights -- maybe call it "training rights." It won't matter whether the text was purchased or pirated -- just like it doesn't matter now if an audio track was purchased or pirated, when it's mixed into in a movie soundtrack. Talent agencies will negotiate training rights fees in bulk for popular content creators, who will get a small trickle of income from LLM providers, paid by a fee line-itemed into the API cost. Indie creators' training rights will be violated willy-nilly, as they are now. Large for-profit LLMs suspected or proven as training rights violators will be shamed and/or sued. Indie LLMs will go under the radar.
- phkahler 3y ago>> Talent agencies will negotiate training rights fees in bulk for popular content creators AFAICT there is no legal recognition of "training rights" or anything similar. First sale right is a thing, but even textbooks don't get extra rights for their training or educational value.
- belorn 3y agoMany legal concepts used by courts has no legal recognition in the law texts. Much of legal practice are just precedents, policies, customs, and doctrines. Parent comment mention music synchronization rights, and this concept does not exist in copyright. Court do occasionally mention it, and lawyers talks about it, but in terms of the legal recognition there is basically only the law text that define derivative work and fair use. One way to interpret it is that court has precedents to treat music synchronization as a derivative work that do not fall under fair use. Using textbooks in training/education is not as black and white that one may assume. Take this Berkeley (https://teaching.berkeley.edu/resources/course-design/using-copyright-materials-classroom https://teaching.berkeley.edu/resources/course-design/using-...). Copying in this context include using pages for slides and during lectures (which is a slightly large scope than making physical copies on physical paper). In obvious case the answer is likely obvious, but in others it will be more complex.
- sigstoat 3y ago
- itronitron 3y ago>> blog authors weren't giving consent either. That is a good point, since copyright is a default protection of works created by people.
- version_five 3y agoSeems like the AI angle is just capitalizing on hype. If it's illegal to download "pirate" copyright material, that was the crime. The rest is basically irrelevant. If I watch a pirated movie, it's not illegal for me to tell someone the plot.
- pkilgore 3y agoThe "fun" part about cases like this is that we don't really know what the contours of the law are as applied to training data like this. Illegally downloading a book is an independent act of infringement (to my recollection at least). So I'm not sure that it matters if you eventually trained an LLM with it vs read for your own enjoyment. But we will see! Fair use is a possibility here but we need a court to apply the test and that will probably go up to SCOTUS eventually.