3 ms·

If you are the sole creator of a content, yes, you should be mentioned. But when 1000 others have written the same thing, like a ToDo app or a sorting algorithm

If you are the sole creator of a content, yes, you should be mentioned. But when 1000 others have written the same thing, like a ToDo app or a sorting algorithm, then it becomes impossible to name all the authors, or to disentangle their influences. Technically it could be possible to have author metadata either prefixing or postfixing content, that way the model learns to generate from an author style or to predict the (likely) attribution of a snippet. Or they could create a BERT embedding model for author metadata and another for content, and train them with the CLIP method. So the model would learn to map text to author embeddings. There are tons of data with author and date - books, journals, papers, media articles, blog posts, social network posts, github repos - they all provide a way to index ideas to their authors and in time, so we could potentially find who first invented an idea and who expanded on it later. The negative effects could include disclosing authors of anonymous texts online, or disclosing the sources of influence of one author even when they keep them secret, or don't even realize themselves. Could be embarrassing to have your sources outed like that. You might find out your original ideas were invented elsewhere.

eesmith 2y ago
The topic wasn't really about something like "where did this bubble sort come from" but about bulk removal apparently before training, such that: > .. if I ask something like Claude, "what sort of code has Justine Tunney wrote?" it hasn't got the faintest idea. Instead it thinks I'm a political activist, since it feels no guilt remembering that I attended a protest on Wall Street 13 years ago.
jart 2y ago
That's like saying Shakespeare shouldn't be credited for Romeo and Juliet because he's not the first guy to have written a love story and it's impossible to disentangle his ideas from that of Elizabethan culture. It's pure rubbish. When you're an open source volunteer who isn't being paid, credit is the only thing you can hope to gain and to deprive people of that is just cruel. If AI can consider author data, then we might even learn the truth about provenance too. It could illuminate who the unsung heroes are. You won't have to evangelize your work like PT Barnum to get recognition.
- sidewndr46 2y ago
  Even further: I don't think there is any evidence Shakespeare wrote his works as we know them. After his death some friends worked together to assemble his works
YeGoblynQueenne 2y ago
Note that the above article is not just about attribution but also about inclusion of licenses with the copies of licensed code, something that, as far as I can tell, no LLM ever does. Is this because the code is so mashed together that it's impossible to say which bit was copied from which original source? Well, then, that's a very big problem and if a human did this we'd rightly label it plagiarism.

eesmith 2y ago

The topic wasn't really about something like "where did this bubble sort come from" but about bulk removal apparently before training, such that: > .. if I ask something like Claude, "what sort of code has Justine Tunney wrote?" it hasn't got the faintest idea. Instead it thinks I'm a political activist, since it feels no guilt remembering that I attended a protest on Wall Street 13 years ago.

jart 2y ago

That's like saying Shakespeare shouldn't be credited for Romeo and Juliet because he's not the first guy to have written a love story and it's impossible to disentangle his ideas from that of Elizabethan culture. It's pure rubbish. When you're an open source volunteer who isn't being paid, credit is the only thing you can hope to gain and to deprive people of that is just cruel. If AI can consider author data, then we might even learn the truth about provenance too. It could illuminate who the unsung heroes are. You won't have to evangelize your work like PT Barnum to get recognition.

sidewndr46 2y ago
Even further: I don't think there is any evidence Shakespeare wrote his works as we know them. After his death some friends worked together to assemble his works

YeGoblynQueenne 2y ago

Note that the above article is not just about attribution but also about inclusion of licenses with the copies of licensed code, something that, as far as I can tell, no LLM ever does. Is this because the code is so mashed together that it's impossible to say which bit was copied from which original source? Well, then, that's a very big problem and if a human did this we'd rightly label it plagiarism.