5 ms·
> The complexity described seems to be resting on the unestablished idea that weights are copyrightable in the first place. Yes. Weights probably aren't copyri
by Animats 3y ago
> The complexity described seems to be resting on the unestablished idea that weights are copyrightable in the first place.
Yes. Weights probably aren't copyrightable in the US. See Feist vs. Rural Telephone, in which the Supreme Court ruled that telephone directories are not copyrightable. The copyright clause in the Constitution ("To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries.") is understood to require human authorship. The US does not have database copyright, or "sweat of the brow" copyright. That it was expensive to produce some collection of data does not make it copyrightable.
Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either. US Copyright Office: "Based on the Office's understanding of the generative AI technologies currently available, users do not exercise ultimate creative control over how such systems interpret prompts and generate material. Instead, these prompts function more like instructions to a commissioned artist."[1]
[1] https://www.reuters.com/world/us/us-copyright-office-says-some-ai-assisted-works-may-be-copyrighted-2023-03-15/ https://www.reuters.com/world/us/us-copyright-office-says-so...
- DannyBee 3y agoThis is mostly right - It depends on what the weights represent and how they were generated so I would not go as far as the initial claim. A collection of numbers is copyrightable if it's the encoded result of a creative process. Just because it's represented as a bunch of numbers does not make it non copyrightable. That's why it says " original works of authorship fixed in any tangible medium of expression, now known or later developed, from which they can be perceived, reproduced, or otherwise communicated, either directly or with the aid of a machine or device. " You can't just classify the weights as facts simply because they are numbers. If they are creatively made by a human they would be copyrightable. Mechanically computed from random numbers, no. Somewhere in the middle? Harder
- kevin42 3y agoI'm not a lawyer, but it seems like you stood up a straw man there. >Just because it's represented as a bunch of numbers does not make it non copyrightable. Can you give an example of where the bunch of numbers is copyrightable when it's not just a numeric encoding of something that was already copyrightable? Taking music and encoding it as a wav file is not a creative work, but it's a representation of a copyrighted work. Maybe you could create a long list of numbers and call it an artistic impression, but that's clearly not what AI weights are. I'm interested to hear an example of your copyrightable numbers.
- mlyle 3y agoThe key factor of Feist v Rural is whether there was any original or creative process in the way the facts were arranged. Here, there's a whole lot of creative decisions in labelling and guiding of training that produces the weights, so it's reasonable to think it might be copyrightable. That is, the numbers are a whole lot more original than the issuance of phone numbers or part numbers.
- mft_ 3y agoIANAL, but I’d wonder whether ‘creativity’ is really present in labelling - and indeed, mightn’t it be the last thing you want? I’d argue labelling should be strictly factual and reproducible, and ideally following a logical structure… maybe akin to how addresses of buildings might appear in a phone directory… (Agree that the skill in knowing how to code and guide the training of a model is probably very different though. It’s not just access to compute time that separates me from OpenAI :) )
- dragonwriter 3y ago> Here, there's a whole lot of creative decisions in labelling and guiding of training that produces the weights Often, labelling is part of large public datasets that are chosen for use for that exact reason, and/or is otherwise not the work of the party claiming copyright in the model.
- deleted 3y ago[deleted]
- Retric 3y agoThe requirement for expertise doesn’t necessarily imply that that setting up perimeters for training AI is necessarily copyrightable. A normal brick wall for example needs skills to create but doesn’t qualify as the goal is not creative. If so the mechanical output of a process that doesn’t qualify for copyright is not going to qualify. Labeling training data may qualify for copyright, but if the underlying training data doesn’t taint the output as a derivative work then labeling isn’t going to qualify by itself. Thus without some new and very generous interpretation AI companies are at best not going to benefit from copyright and at worst may be forced to create all training data in house. My suspicion is this generation of AI companies are in a very difficult situation.
- saynay 3y agoI would say that is uncertain. Model weights are always going to effectively be a huge collection of statistics about the training corpus. Unless you are envisioning artisanal, hand-crafted, free-range model weights where a person used a non-mathematical method to purposely and creatively choose each one?
- dxbydt 3y ago> Mechanically computed from random numbers, no Even random numbers are copyrightable. Below is an implementation of Marsaglia's invention, from p348, courtesy infamous NR[1]. Its a MWC (multiply with carry) random number generator, with two parameters, variable a and base b=2^32. --- For a, "The values below are recommended with no particular ordering." ID a B1 4294957665 B2 4294963023 B3 4162943475 B4 3947008974 B5 3874257210 B6 2936881968 B7 2811536238 B8 2654432763 B9 1640531364 --- as we all now know, the whole thing is copyrighted - you can't redistribute that code and can't use those specific numbers to generate random numbers without purchasing a license, which only allows you to use it once in your personal machine; that's why GSL[2]. The pseudorandom numbers you would get from MWC if you use above numbers are also copyrighted since they are work-product. [1]http://numerical.recipes/book/book.html http://numerical.recipes/book/book.html [2]https://www.gnu.org/software/gsl/design/gsl-design.html https://www.gnu.org/software/gsl/design/gsl-design.html
- mirekrusin 3y agoAssuming that weights are not copyrightable, how much restrictions can you put on output through API from those networks/weights? Ie. if ClosedAI says you can't use output of their API to train competitive models - is that enforceable or not?
- photonerd 3y agoThat would be down to contract/terms of service. You’d be in breach of that, not copyright
- mirekrusin 3y agoBut is it enforceable? Companies can put in contracts all kind of nonsense, it doesn't mean all of it is unconditionally enforceable, right? Ie. if somebody creates company that sells milkshakes and they say you can't use them to feed employees of competing milkshakes companies - it wouldn't fly, would it?
- photonerd 3y agoWould strongly depend on the contract. Probably wouldn’t fly in a post sake terms of service agreement, but you’d likely be in breach of a normal contract yeah.
- hnfong 3y agoPerhaps you're thinking of the EULA kind of situation. EULAs are probably not enforceable because they require the user to agree to additional terms after the main sale of contract is complete. It's considered a one-sided agreement because the user doesn't get anything in return (the contract of sale of the software already grants the right to use the software). For LLMs it really depends on the situation. If it's presented in a EULA scenario, where you already bought the rights to use the LLM and ClosedAI gave you the EULA with additional terms afterwards, then the logic above applies. But then everyone knows EULAs aren't very enforceable these days, and nobody buys packaged software any more, so this scenario is quite unlikely these days. So, if the clause is just one of the many conditions in their main contract of service, of which you had ample opportunity to review before purchasing/agreeing to use their service, then as long as the terms are legal (eg. don't contradict some law), parties are generally free to agree to whatever they want in a contract, and courts will generally uphold those terms. "can't use them to feed employees of competing milkshakes companies" is probably enforceable. Sounds silly, but I can't think of any reason why it wouldn't be upheld. Unless there's antitrust factors involved. "Can't use output of their API to train competitive models" is most likely enforceable. Unless there's antitrust factors involved. These kinds of terms are pretty common too. Nobody seriously thinks they're unenforceable per se. Of course there are practical barriers to enforce a contract -- the aggrieved party has to discover the breach, gather sufficient evidence, and file a lawsuit. As an average Joe individual, you're probably not worrying about getting sued by a company for trivial breaches of service agreements. Most likely the service provider will just cut the service instead of spending thousands of dollars tracking you down (and risk taking a PR hit for going after the little guy). But between businesses, the risks of getting sued by a competitor is real, and no sane lawyer would advise the business to ignore such contract terms. (Btw, I am not a lawyer. I've studied these things a bit though.)
- dllthomas 3y ago> Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either. I don't have a strong sense of whether this is reasonable (I see arguments both ways) but I do think it's pretty strongly at odds with how we treat photographs. There are a bunch of photos on my phone where I unquestionably own the copyright, despite putting in much less creativity than I did for some AI images I've generated. I don't think it's clear how to resolve this, but I do think that if we are going to protect photos and not prompted AI images, the distinction needs to turn on something other than whether "sufficient creativity" was applied to the input of the mechanical system. Edited to add: It's probably also worth calling out that the question of whether we protect the work produced by a person's use of mechanical system is a separate one from whether we protect the work of others when it is (in various ways, to various degrees, with various likelihoods) reproduced by use of those mechanical systems.
- makeitdouble 3y agoOn photography, the argument was condensed into "who pushed the button". We saw it with the monkey auto-portrait copyright fight where copyright was not granted to the photographer, and other nature photography using photo traps where the copyright stuck with the human basically because they were the last operator of the camera. The interesting part is, those controversial case are pretty recent when the art of photography is century(ies?) old now. I wouldn't expect super clear guidelines regarding AI art before a few decades of weird cases fought tooth and nails in court.
- tokai 3y agoEh? The copyright was the photographers and not the monkeys. https://petapixel.com/2018/04/24/photographer-wins-monkey-selfie-copyright-case-court-slams-peta/ https://petapixel.com/2018/04/24/photographer-wins-monkey-se...
- shagie 3y agoYou'll still face an uphill battle. https://www.copyright.gov/comp3/chap300/ch300-copyrightable-authorship.pdf https://www.copyright.gov/comp3/chap300/ch300-copyrightable-... 313.2 Works That Lack Human Authorship As discussed in Section 306, the Copyright Act protects “original works of authorship.” 17 U.S.C. § 102(a) (emphasis added). To qualify as a work of “authorship” a work must be created by a human being. See Burrow-Giles Lithographic Co., 111 U.S. at 58. Works that do not satisfy this requirement are not copyrightable. The U.S. Copyright Office will not register works produced by nature, animals, or plants. Likewise, the Office cannot register a work purportedly created by divine or supernatural beings, although the Office may register a work where the application or the deposit copy(ies) state that the work was inspired by a divine spirit. Examples: • A photograph taken by a monkey. • A mural painted by an elephant. ... Similarly, the Office will not register works produced by a machine or mere mechanical process that operates randomly or automatically without any creative input or intervention from a human author. The crucial question is “whether the ‘work’ is basically one of human authorship, with the computer [or other device] merely being an assisting instrument, or whether the traditional elements of authorship in the work (literary, artistic, or musical expression or elements of selection, arrangement, etc.) were actually conceived and executed not by man but by a machine.” U.S. COPYRIGHT OFFICE, REPORT TO THE LIBRARIAN OF CONGRESS BY THE REGISTER OF COPYRIGHTS 5 (1966).
- radarsat1 3y ago> Weights probably aren't copyrightable in the US. ... is understood to require human authorship. Are you arguing here that because the weights come from an optimization program, they are not "human authored"? If so I find that to be a strange assertion. If I'm working every day on my model and training algorithm to ensure it produces the best weights possible to solve my problem, I would be very surprised for someone to tell me I have no ownership over those weights because they are generated from a program I wrote and data that I own.
- hnfong 3y agoIn addition to what you mentioned, I'd like to add that photos are copyrightable by the photographer, who merely tweaked some "hyper-parameters" (exposure, ISO, aperture, whatever) and decided when and where to press a button. If such "minimal" amounts of authorship is considered sufficient, I won't be as confident as GP to claim that training an LLM, which requires orders of magnitudes more hyperparameters, labor and capital investment, to be uncopyrightable due to lack of human authorship involved. It might end up uncopyrightable due to other reasons, but probably not this. Btw, the phone directories are quite different -- they're just compilation of raw factual public domain information. The LLM weights are anything but. In fact one of the leading theories as to why LLMs are not copyrightable is that they infringe upon the copyrights of the source training materials. (I also don't want to guess whether that argument holds)
- deepsun 3y ago> Outputs from LLMs, machine generated art, and machine generated music probably are not copyrightable either. Let me put a straw man, and try to find a middle point, when the copyright argument stops being applicable: 1. A painting was done by an artist. 2. On a computer. 3. With a help from an image processor software. 4. Using some advanced filters, like super-resolution, that utilize computer vision techniques. Like neural networks. Many smartphones already automatically process your* photos with some advanced CV algorithms. That can be called "machine generated art". I'd personally prefer to stop saying "neural network did X", same way as we don't say "a bulldozer built a road, a crane built a house".
- comfypotato 3y agoThe distinction, defining your straw man, is simply that the image itself is generated by the “commissioned artist” that is the AI. Even non-generative-AI inside Photoshop only mutates images. Generative AI is the source of images.
- drdeca 3y agoIs it though? What of the e.g. choice of prompt, guidance scale, maybe a specification of a pose, etc.? Or, is the distinction you are making based on there being an image before the model is used?
- deepsun 3y agoI'm not sure I understand the "source" term here. All the AI images I've seen so far were generated by humans using software tools like neural networks.
- Veserv 3y agoIANAL, but weights are probably not copyrightable because they are “useful” i.e. they have intrinsic utilitarian function as they are necessary for a model to function as described. Useful things can not be copyrighted, only patented. This is the key difference between the two. For works that are useful and creative, only the non-functional aspects can be copyrighted. Maybe a published copy of the weights might be copyrightable, in the exact form of a “creatively” ordered listing, but the weights themselves would almost certainly not be if the US judicial system rules consistently. This bypasses the entire argument of whether it is human authorship as weights themselves in bulk are just straight up non-copyrightable regardless of origin according to this reading of the law and precedent.