3 ms·
> The lawsuit against OpenAI alleges that summaries of the plaintiffs’ work generated by ChatGPT indicate the bot was trained on their copyrighted content. “The
by int_19h 3y ago
> The lawsuit against OpenAI alleges that summaries of the plaintiffs’ work generated by ChatGPT indicate the bot was trained on their copyrighted content. “The summaries get some details wrong” but still show that ChatGPT “retains knowledge of particular works in the training dataset," the lawsuit says.
Setting aside the whole issue of whether LLM constitutes a derived work of whatever it's trained on, this sounds like a very weak argument to me. An LLM trained on numerous summaries of the works would also be capable of producing such summaries itself even if the works were never part of the training set. In general, having knowledge about something is not evidence of being trained on it.
- TheDong 3y agoThat isn't firm evidence, but courts don't need firm evidence to start a case and discover new facts. They very well can ask LLM experts, and openAI themselves, whether that output is highly likely to have been derived from the copyrighted work in question. Anyway. If the argument is "No, it's not from the book, it's from someone else's copyrighted summary", that just means the person who wrote such a summary needs to instead sue for copyright infringement right? Unless openAI turns around and says "actually, no, not the summary, the full book" then.
- cgriswald 3y agoA summary can be written in such a way as to violate copyright itself. So even if they say "We trained it on the following summaries:...," there could be an issue.
- deleted 3y ago[deleted]
- visarga 3y ago> that just means the person who wrote such a summary needs to instead sue for copyright infringement right? Doesn't need to be a person, could be another AI that wrote the summaries. I see a big problem for copyrights looming on the horizon - LLMs can reword, rewrite or generate input-output pairs using copyrighted data as reference, thus creating clean data for training. AI cleanly separates knowledge from expression. And maybe it should do so just to reduce inconsistencies and PII in organic text. Copyrights should only be concerned with expression not knowledge, right? Protecting knowledge is the object of patents, and protecting names the object of trademarks. Copyright is only related to expression otherwise it would become too powerful. For example, instead of banning reproduction of this paragraph, it would also cover all its possible paraphrases. That would be like owning an idea, the "*" version, not a unique sequence of words. Does it even make sense to talk about copyrights when everything can be remade in many ways so easily? Copyright was already suffering greatly since zero cost copying became a thing, now LLMs are dealing the second blow. It's just a fig leaf by now. If we take a step back, it's all knowledge and language, self replicating memes under an evolutionary force. It's language evolution, or idea evolution. We are just supporting it by acting as language agents, but now LLMs got into the game, so ideas got a new vector of self replication. We want to own this process piece by piece but such a thing might be arrogant and go against the trend. Knowledge wants to be free, it wants to mix and match, travel and evolve. This process looks like biology, it has a will of its own.
- imglorp 3y agoThere's an interesting nuance here if you were to put a human in the place of the LLM. We have read thousands of works; does that mean anything we write is derivative?
- TheDong 3y agoHumans are special and can create new copyrights. The process of a human brain synthesizing stuff does act as a barrier to copyright infringement. Machines and algorithms are not legally recognized as being able to author original non-derivative works. > put a human in the place of the LLM But also, no, if you have a team of humans doing rote matrix multiplication instead of an LLM, that does not make it so the matrix multiplication removes copyright. Also, at this point LLMs require so much math that you can't replace them with humans, even if the humans have quite fast fingers and calculators.
- throwaway09223 3y agoNot really. The "special" quality attached to humans is only in creating copyright -- it has nothing to do with fair use arguments around derivative works. "Machines and algorithms are not legally recognized as being able to author original non-derivative works" Neither are monkeys. This doesn't mean a monkey's painting is any more or less derivative, or any more or less subject to a copyright claim. It only means that there is not a second copyright attached to the resulting work.
- TheDong 3y agoMonkeys aren't algorithms nor computers, so that doesn't seem very relevant. Let's look at a totally different analogy: compression algorithms. If I take a digital artist's work which they publish as a png or psd file, and I use some algorithm to convert it to a jpg file, well, I definitely transformed the work in terms of bytes. It's a smaller file, I threw out a lot of data, you can't get the original back. Yet, this does not change the copyright in any way. A computer applied a rote transformation. An LLM is really just a very complicated compression algorithm. It takes an input of a bunch of copyrighted works, compresses them into a model, and then uses more algorithms to uncompress them into approximations of the original ("responses") In the image analogy, an LLM response is similar to upsizing the compressed jpg back into a png (and getting a slightly different image since the process was lossy). Is there a way that an LLM isn't, legally, a compression algorithm for a large set of copyrighted works?