4 ms·
Look for desperate, heavily funded lobbying efforts to create new expansions of copyright, or something like it. LLM-based music generators do what musicians d
by Animats 3y ago
Look for desperate, heavily funded lobbying efforts to create new expansions of copyright, or something like it.
LLM-based music generators do what musicians do - listen to a lot of stuff and then generate their own music. Most popular music isn't that original.
It's mostly about branding.
- freedomben 3y agoYep, between photographers, graphic artists, and musicians I've already seen a massive number of people clamoring for expanded copyright. The wildest thing is, just a couple years ago these people were some of the most vocal against the copyright system, especially those hit by take downs on youtube and other sites.
- visarga 3y agoCreatives forget the tools AI companies will develop for attribution will be applied on their own works as well, and unwanted attributions might pop up. We don't like to admit how much our own creativity is just derivative from a place we forgotten about. But when they make the attribution microscope, it won't be just AIs getting scrutinized. We have plenty of content with attribution to train such a system - books, art, scientific papers, media articles, even social network comments, we know author and date. We can index everything by author and search against the index to find influences. We can train "text -> author" and the use it for "new text -> attributions". But will such a system ultimately enable or block creativity? Even past works stand to be revealed in all their influences. Might be embarrassing. On the other hand generative models will be safe as they can sample around problematic attributions and still complete their tasks. We might end up having to use AI for writing in order to ensure copyright safety. The irony. "I heard you don't like AI in creative fields so from now on you need to use AI to ensure other creative's ideas are not used by mistake, or risk getting sued."
- freedomben 3y agoFascinating thoughts, wish I had more than one upvote to give. You make a great point, this could end up backfiring spectacularly because it may expose how unoriginal a lot of work really is.
- aatd86 3y agoCoders will have too as well. Coding is an art. Half-seriously though, being able to provide tooling that could fund a given library could be endangered if global llms can just suggest things because they have parsed a wide array of code. Maybe it is a lost fight and the value has to be found somewhere else though. Anything physical like deployment, hosting, that AI cannot do, at least for the foreseeable future.
- bayindirh 3y ago> LLM-based music generators do what musicians do - listen to a lot of stuff and then generate their own music. I love this analogy, because it looks so benign, while being so off. Question: How many hours of music an LLM can listen and ingest in an hour? Answer: Probably 10x more than a human, and will ingest it way better in one go than a human who needs 5-10x concentrated listens to completely understand what's going on at all layers. So, in practice, an LLM can ingest 50-100x more music in unit time, when compared to a human. "An LLM is like a musician. Just listens". Indeed, that's true, if I wince really hard, so my head hurts. BTW, I'm all for respecting copyright, and no, AI training is not fair use, because AI is not a human who consumes reasonable amounts of information and understands and derives it in a unit time.
- krapp 3y agoSomeone needs to create a "Godwin's Law" for AI such that for any discussion of LLMs on the web, the chance that someone will equate LLMs to humans equals one.
- soulofmischief 3y ago> AI training is not fair use, because AI is not a human who consumes reasonable amounts of information and understands and derives it in a unit time. Please illustrate why "LLMs ingest training data faster than humans and have better recall" has anything to do with fair use.
- bayindirh 3y agoFrom [0], Notwithstanding the provisions of sections 17 U.S.C. § 106 and 17 U.S.C. § 106A, the fair use of a copyrighted work, including such use by reproduction in copies or phonorecords or by any other means specified by that section, for purposes such as criticism, comment, news reporting, teaching (including multiple copies for classroom use), scholarship, or research, is not an infringement of copyright. In determining whether the use made of a work in any particular case is a fair use the factors to be considered shall include: 1. the purpose and character of the use, including whether such use is of a commercial nature or is for nonprofit educational purposes; 2. the nature of the copyrighted work; 3. the amount and substantiality of the portion used in relation to the copyrighted work as a whole; and 4. the effect of the use upon the potential market for or value of the copyrighted work. The fact that a work is unpublished shall not itself bar a finding of fair use if such finding is made upon consideration of all the above factors --- Let's polish over the "scholarship, or research" clause for a moment, because none of the commercial entities are doing it for research. Assuming the fair use clause didn't fail there, let's focus on two important points: 3. the amount and substantiality of the portion used in relation to the copyrighted work as a whole; and 4. the effect of the use upon the potential market for or value of the copyrighted work. First of all, an LLM remembers almost all of its training material verbatim, or almost verbatim, which is undoubtedly a substantial amount of the work ingested*, and secondly, the effect of such systems on the whole market or job ecosystems is disruptive. You can create something in the style of someone from your couch for free or $10/mo. Whatever you do, you can create derivative works of the ingested works, or derivative works containing ingested parts verbatim at great speed with this "Shiny LLM thing". A human neither can ingest that amount of information, nor retain all of it that perfectly, hence limiting the inspiration from these works, and forces one to add their own original ideas or inspirations rooted in other sensory inputs (feelings, sight, own experiences, etc.), not reducing the value of the work used, or not damaging the creator of the work the creator got inspiration. Incidentally, we have a word for cases this inspiration gets a bit too far: "plagiarism". From that point, an LLM, which remembers everything verbatim and mixing them together is arguably making plagiarism from many sources to create their own works, while being unable to cite them accurately. A very useful property, indeed. *: I know how an LLM stores its data in its weights, but even without the data itself, the weights can construct the training data verbatim in many cases, so it stores its training data. Not in its original form, but in a derivative and reversible form, not unlike compression. [0]: https://en.wikipedia.org/wiki/Fair_use#U.S._fair_use_factors https://en.wikipedia.org/wiki/Fair_use#U.S._fair_use_factors
- notahacker 3y agoNo "expansion of copyright" is needed in music, the requirements in the US are already onerous enough for the entirely original human-written and performed Blurred Lines to be deemed a copyright violation for consciously emulating the "feel" of a Marvin Gaye baseline. The people that need to change this status quo - like it or loathe it - are the people that want to profit from spamming streaming services with zero-effort derivatives of popular music (people that do it for fun or use 'AI' tools for post production or loop-variation will continue to be fine). I have a lot less sympathy with them than the many artists who've lost court cases for 'inspiration', and if they're relying on the whole "models learn just like people" canard they're going to be in a weaker position than usual, because not only is that deemed insufficient for people, but it's unambiguously untrue that machines "listen" like humans do (they're bulk processing files, not experiencing consonance or dissonance in the ear) or that they "perform" as opposed to stochastically transferring elements of style. Even the most cliched blues going has human reasons for note choice and intonation other than "weighted average of other blues with overlapping description"
- ben_w 3y ago> Even the most cliched blues going has human reasons for note choice and intonation other than "weighted average of other blues with overlapping description" From what I've heard about human cognition, we come up with a word-based justification after we decide what to do, it just that the research involved a brain scanner to find this out because it doesn't (usually[0]) feel like this is what's going on on the inside. So the real reason may well be "weighted average of other blues with overlapping description", followed (not preceded!) by a language model producing some convincing words that can communicate the mental state to other humans. IMO, the main difference between AI and humans right now, is that humans can do human things with far fewer examples. AI has the speed advantage that lets them read all the words in the world, listen to all the music ever recorder, watch all the videos ever filmed… but are so stupid[1] that they need to, too. [0] I do sometimes notice this in my own brain: I can have a fully-formed sentence before my inner dialogue tries to (for a lack of a better word for the internal voice) "speak" it — if I then try to skip the inner voice because I've already had the thought and turning into an imagined voice is clearly a waste of time, the part of me which is the inner voice is, for lack of a better word, frustrated. [1] Stupid on this particular axis. Intelligence isn't fantastically well defined even in humans, is badly defined cross-species, and doesn't have a singular definition at all for machines, so it is perfectly valid to consider intelligence to be a question of "what can it do?" rather than "how fast does it learn?", for which many current AI (there's no G, so narrow AI that only plays chess is fine) "smarter than humans".
- whiddershins 3y agoLLMs don't listen. LLMs don't do anything. People do things with LLMs. People write and run code that creates LLMs. These words "train", "learn" are ML terms that attempt to explain a concept using an analogy. The LLM isn't a person. Speaking of the LLM as if it is a person, has the rights of a person, or should be legally treated as a person, is a category error.