3 ms·
Why do you think training data is a violation of copyright? What is being copied?
by wvenable 3y ago
Why do you think training data is a violation of copyright? What is being copied?
- sdenton4 3y agoDid OpenAI buy a copy of every book in The Pile? Or did they all just fall off the back of a truck? Aside from that question, I tend to agree with the judge - LLM outputs are obviously not derivative works or copies in any sense that we normally use the phrase.
- sillysaurusx 3y agoOpenAI hasn’t trained on The Pile, as far as I know. I think you mean "Did Meta buy a copy of every book in books3?" since llama wasn’t trained on The Pile either. And the answer is no. It seems important for the answer to remain no, otherwise the only entities that can afford to train on sufficient numbers of books will be big companies. No one can afford 190,000 books except huge corporations, so we’ll be surrendering our ability to train our own useful models if the price of training is that high. 190k books isn’t even that much. OpenAI probably trained on millions.
- tayo42 3y agoIf the only issue is paying for a copy, thinking out loud, It would be interesting if some ebook lender like libby let you queue up a whole bunch of books to borrow, train on the return it.
- __loam 3y agoOpenAI obviously copied the data onto their servers when they collected the training data.