4 ms·
Say I make a tool where you can enter the title of a book, and get the full text of the book without paying for it. I assume we all agree that would be illegal,
by palata 3y ago
Say I make a tool where you can enter the title of a book, and get the full text of the book without paying for it. I assume we all agree that would be illegal, right?
Now say that instead of distributing that tool as an executable, I distributed it as a library. It would contain all the same books as the illegal executable above, but some developers would need to write an actual executable that would use the library. Obviously that executable would be illegal (same as the first one above), but would the library be illegal? I would think that we all reasonably agree that my library would be illegal, because I would essentially be selling the content of books for which I don't own the copyright.
Now what happens when I distribute a trained model that has the potential to generate illegal work? Is it suddenly legal for me to sell it, because some developers write legal executables with it? How is that different from my library example above?
- JoeAltmaier 3y agoCuriously that is a pretty close description of a normal neighborhood library.
- palata 3y agoPretty close, and yet so different. Don't you agree that I am allowed to buy a physical book and then resell it, but that I am not allowed to buy a physical book, make copies of it, and sell those copies?
- harshreality 3y agoThe doctrine of first sale would never be allowed today if it hadn't already been enshrined in law over 100 years ago. Stakeholders would insist that creators wouldn't create if people could fund community libraries and thereby shrink the book market. They'd demand the same thing for physical books that they've implemented for almost all ebooks: a pay-per-lend system. The effect would be a substantially higher cost for each loan-out. Congress would go along, just as they went along with a new copyright term of min(120, life+70) years. In the U.S., in 1909 when the doctrine of first sale was codified, the copyright term was 28 years + 28 years upon renewal, and copyright had to be registered. That would never be accepted by copyright interests today, either.
- mythhabit 3y agoA car has the potential to be used for illegal activities. In fact happens every second, but that does not mean we go out of our ways to make them illegal. That said, it is still an open question if the content generated by LLM is illegal. It only generates content that is inspired by some authors work, it is not recreating their work, only their style. Humans copy each other all the time in writing, music, art, you name it.
- palata 3y agoEither you completely missed my point, or you genuinely believe that my first executable is legal. Which one is it?
- mythhabit 3y agoI do not buy the premisses. Your example states that it can provide the full text of any book. An LLM cannot do that. They can produce something in the same style and setting. When an actual human author mimics other writers styles, it is not illegal, why exactly should it be illegal for an author to use an LLM to do it?
- palata 3y ago> When an actual human author mimics other writers styles, it is not illegal, why exactly should it be illegal for an author to use an LLM to do it? There is a fundamental difference of scale. Say I write a blog post about some technical thing I know. You read it, learn from it (and other sources), and then you write your own blog post with your understanding. You may link to my post (if you believe it is heavily inspired from there), or not. But reading my post, understanding the material to the point where you can write about it took time. If you are so fast that you can produce more posts than I do, and your posts are the same quality, then suddenly you become a better blogger than me. An LLM can automate that. With an LLM, you as a blogger don't have to learn from my post, you can just have it generate the post (you don't even need to read it). In that case, you have put absolutely zero effort learning about the topic, you just had some algorithm copy-paste-and-modify my post. Don't you think that if you publish a blog post that you haven't even read yourself, probably it comes from material written by somebody else at some point? In any case it is very different. Once a human does it, the other time a machine does it. I don't understand why engineers think we can just transfer concepts between both. You as a human have rights (maybe you can vote), but your LLM cannot. Why couldn't an LLM vote if humans vote? Precisely because it is different, and it creates new problems. The fact that LLMs can automatically (and at scale) launder copyrighted material is a new problem. Therefore we need to think about that, and to think about whether or not this should be legal. The day people stop reading my blog and instead use ChatGPT (which is trained using, among the ton of other copyrighted material, my blog), and as a result nobody reads my blog directly anymore, I can assure you that I will stop writing. If 99% of books are written by ChatGPT instead of actual authors, but based on books from actual authors, in such a way that the readers don't really make a difference and therefore go with ChatGPT (because it's cheaper), what do you think writers will do? If they can't live from writing books (because ChatGPT does not buy their books, and people now pay ChatGPT instead of buying the books), then they will just stop writing. It is a risk that needs to be considered. And it's certainly not an engineering question.
- assbuttbuttass 3y agoGreat example! I think your library wouldn't be illegal itself, but distributing it would be illegal.
- danielbln 3y agoOne can use Photoshop to create heinous things which would be highly illegal to sell, or even show. Should we ban Photoshop? I think we agree, that no, that would be silly. Let's assume I train a model on public domain texts only, zero copyrighted material has gone into it. Yet, technically and also practically, the model would have the ability to create illegal, copyright infringing content, given the right input. Should distribution of such a model be illegal? I think not. Also, let's keep in mind that these models are not archives, that contain the original data verbatim. They are effectively lossy compression algorithms, that capture the essence. Some models are a few tens of GB in size, yet have been trained on TB worth of data, so clearly a significant data loss has occurred, so it's a bad analogy to your "keep a bunch of books as in a library" example.
- palata 3y ago> One can use Photoshop to create heinous things which would be highly illegal to sell, or even show. Should we ban Photoshop? I think we agree, that no, that would be silly. This is a different matter, just like saying "we don't make cars illegal even though cars can be used illegally". IMO it is off topic in the context of my post above (or you need to elaborate). > Let's assume I train a model on public domain texts only, zero copyrighted material has gone into it. Do you genuinely not see the difference, from the point of view of the copyright holders? If OpenAI could build a version of ChatGPT without using any copyrighted material at all, I agree with you: it should not be made illegal. But the illegal use of it should be. I guess we agree here, but to me that is quite different from training ChatGPT with copyrighted material. The first difference being... well... good luck training ChatGPT without copyrighted material (probably now it's too late anyway, because weights of models trained from copyrighted material are just all over the Internet). > Also, let's keep in mind that these models are not archives, that contain the original data verbatim. They are effectively lossy compression algorithms, that capture the essence. Say I creat excutable dat do som kind of loss cmpression tht captred essnce. First, do you agree that the sentence above is "some kind of lossy compression that captures the essence"? If yes, would you consider it legal for me to use that algorithm on famous books and sell them under my name, or would you think that I abused the copyright of the original material?
- subroutine 3y agoGoogle Books already does exactly this. It has a library of the full text of millions of books. Users can search for a passage of text and google will display the paragraph where the passage is found. https://books.google.com https://books.google.com example: https://i.ibb.co/DCxJpHN/IMG-3143.jpg https://i.ibb.co/DCxJpHN/IMG-3143.jpg
- palata 3y agoGoogle does not provide the full book, does it? Exactly like they could provide a few seconds of a song, but not the song in its entirety.
- subroutine 3y agoNo, they don't provide the full book, just a few sentences before and after your search prompt (same as Prosecraft). In both cases, however, if you had the patience, you could search the last few words of the text returned from your prior query and slowly work your way through the entire book.
- harshreality 3y agoA few sentences? For most books I've seen, it's a few pages. Google will block you from retrieving more pages from the same book eventually. Using a VPN and a different account may get around one limit, but I experimented with multiple VPNs and browsers once, and although I was able to get a majority of a book's pages, after that google stopped showing me full previews of any of the remaining pages no matter where the request came from.
- subroutine 3y agoIt shows you a few pages if you are previewing the book (i.e. "look inside"). But if you are using search, it will show you where your search query shows up in the book, no matter what page the search query is found. This means you could theoretically search a book sentence by sentence, and it will eventually have shown you the entire book. I'm not claiming this is an efficient or practical way to game the system and read books, only that google books does contain the full copy of the book text and can reveal the contents of any passage. This is basically how Prosecraft works (at least what i glean from the article) - it doesn't let you read a whole book, even though it may contain a representation of the full text.
- dicytea 3y ago> Say I make a tool where you can enter the title of a book, and get the full text of the book without paying for it. Let me introduce you to the Library of Babel[1]. But you need to know the hex! you complain. But that's basically how all of the "AI outputs copyrighted works!!!" gimmicks work. They're impractical unless you know exactly what you want it to reproduce. You can't just casually pick up a copy of Harry Potter like you would in a real library. So is the Library of Babel illegal? What's the difference? [1]: https://libraryofbabel.info/browse.cgi https://libraryofbabel.info/browse.cgi