5 ms·

Is the "books3" dataset mentioned in the Pile paper the one that authors are suing over? The one that includes a whole bunch of popular and copyrighted material

by zellyn 3y ago

Is the "books3" dataset mentioned in the Pile paper the one that authors are suing over? The one that includes a whole bunch of popular and copyrighted material?

Balladeer 3y ago
I believe it is. See https://www.wired.com/story/battle-over-books3/ https://www.wired.com/story/battle-over-books3/
mistrial9 3y ago
this list [0] seems like a starting place to look into various legal actions.. not sure how often it is updated e.g. Silverman et al [0] https://originality.ai/blog/openai-chatgpt-lawsuit-list https://originality.ai/blog/openai-chatgpt-lawsuit-list
- bt1a 3y ago
  Pouring one out for the future litigators, jurors, and judges who will have to pore over this inextricable web of legal and technical details
  - PeterStuer 3y ago
    They'll just let their ai do it over lunch.
taylorfinley 3y ago
Yes, from the linked paper: "Books3 is a dataset of books derived from a copy of the contents of the Bibliotik private tracker made available by Shawn Presser (Presser, 2020). Bibliotik consists of a mix of fiction and nonfiction books and is almost an order of magnitude larger than our next largest book dataset (BookCorpus2). We included Bibliotik because books are invaluable for long-range context modeling research and coherent storytelling"
- pimlottc 3y ago
  This is the most ridiculous legal hand wave I’ve ever seen. “They’re not books, man, they’re a dataset!”
DiggyJohnson 3y ago
Do they claim that none of their data came from copyrighted sources / is copyrighted?
- numpad0 3y ago
  Why do everyone assume "open source" imply legality? (/s)
  - fsckboy 3y ago
    humans have the innate hunter-gatherer sense that generosity and sharing are good for us, and selfishness is bad. And that ethical should be legal and unethical should not be. Open source is generous sharing, and ethical. Start to nibble away at those ideals and at what point do you slip into unethical? IMDB was a crowd-sourced database put together by a wide community pitching in small efforts which one guy was maintaining like an FAQ. Then the guy maintaining it said, "It's worth money, I own it, screw all of you." How would people react if this happened to wikipedia? But wikipedia is safe because it's a non-profit... you know, like OpenAI, right?
- jsheard 3y ago
  "Open source" implies that, no? A definition of open source which includes blatantly pirated material on the condition that the people who collated and released the pirated material did so for free is really stretching it past breaking point. By that standard everything on The Pirate Bay is open source.
- seanhunter 3y ago
  The claim (which I don't personally agree with, but I'm trying to represent here in good faith) is that although the data is copyright, training models constitutes "fair use" under US copyright law and therefore you're entitled to use copyright material for this. Fair to say that whether or not this is correct is pretty important to all the outstanding court cases on this matter.
  - deleted 3y ago
    [deleted]

by zellyn 3y ago

Is the "books3" dataset mentioned in the Pile paper the one that authors are suing over? The one that includes a whole bunch of popular and copyrighted material?

Balladeer 3y ago

I believe it is. See https://www.wired.com/story/battle-over-books3/ https://www.wired.com/story/battle-over-books3/

mistrial9 3y ago

this list [0] seems like a starting place to look into various legal actions.. not sure how often it is updated e.g. Silverman et al [0] https://originality.ai/blog/openai-chatgpt-lawsuit-list https://originality.ai/blog/openai-chatgpt-lawsuit-list

bt1a 3y ago
Pouring one out for the future litigators, jurors, and judges who will have to pore over this inextricable web of legal and technical details
- PeterStuer 3y ago
  They'll just let their ai do it over lunch.

taylorfinley 3y ago

Yes, from the linked paper: "Books3 is a dataset of books derived from a copy of the contents of the Bibliotik private tracker made available by Shawn Presser (Presser, 2020). Bibliotik consists of a mix of fiction and nonfiction books and is almost an order of magnitude larger than our next largest book dataset (BookCorpus2). We included Bibliotik because books are invaluable for long-range context modeling research and coherent storytelling"

pimlottc 3y ago
This is the most ridiculous legal hand wave I’ve ever seen. “They’re not books, man, they’re a dataset!”

DiggyJohnson 3y ago

Do they claim that none of their data came from copyrighted sources / is copyrighted?

numpad0 3y ago
Why do everyone assume "open source" imply legality? (/s)
- fsckboy 3y ago
  humans have the innate hunter-gatherer sense that generosity and sharing are good for us, and selfishness is bad. And that ethical should be legal and unethical should not be. Open source is generous sharing, and ethical. Start to nibble away at those ideals and at what point do you slip into unethical? IMDB was a crowd-sourced database put together by a wide community pitching in small efforts which one guy was maintaining like an FAQ. Then the guy maintaining it said, "It's worth money, I own it, screw all of you." How would people react if this happened to wikipedia? But wikipedia is safe because it's a non-profit... you know, like OpenAI, right?
jsheard 3y ago
"Open source" implies that, no? A definition of open source which includes blatantly pirated material on the condition that the people who collated and released the pirated material did so for free is really stretching it past breaking point. By that standard everything on The Pirate Bay is open source.
seanhunter 3y ago
The claim (which I don't personally agree with, but I'm trying to represent here in good faith) is that although the data is copyright, training models constitutes "fair use" under US copyright law and therefore you're entitled to use copyright material for this. Fair to say that whether or not this is correct is pretty important to all the outstanding court cases on this matter.
- deleted 3y ago
  [deleted]