4 ms·

For those also wondering: https://pile.eleuther.ai https://pile.eleuther.ai > The Pile is a 825 GiB diverse, open source language modelling data set that consi

by sgu999 3y ago

For those also wondering: https://pile.eleuther.ai https://pile.eleuther.ai > The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together. By what's the legal complication with it?

blackeyeblitzar 3y ago
It received DMCA takedowns: https://en.wikipedia.org/wiki/The_Pile_(dataset) https://en.wikipedia.org/wiki/The_Pile_(dataset) > The Books3 component of the dataset contains copyrighted material compiled from Bibliotik, a pirate website. In July 2023, the Rights Alliance took copies of The Pile down through DMCA notices. Users responded by creating copies of The Pile with the offending content removed.
simonw 3y ago
It is absolutely absolutely packed with unlicensed, copyrighted data. Books3 is the most notable example - nearly 200,000 pirated ebooks - but a lot of the rest of it is (unlicensed) scraped web data. The legal questions over whether this is a problem are currently still unresolved. Many people are also bothered by the ethical implications, which is a separate issue from the legal questions.
- deleted 3y ago
  [deleted]
- 23B1 3y ago
  Ironic that even our everyday governance has little 'Alignment' between ethics and law.
  - jacobn 3y ago
    Ethics are a lot more nuanced and change a lot faster than laws. Heck, a large fraction of ethics seem to be so fickle that they’re subject to potential revision by every generation. In fact, I’d argue that those revisions are a significant portion of how one generation distinguishes itself from their parents. Yet strangely every generation feels like they have arrived at a set of “universal laws” in their ethics.
  - KarlKemp 3y ago
    In this case, both ethics and the law are murky. Pretty excellent alignment, for once?
  - ben_w 3y ago
    We wouldn't need lawyers if all the rules could be expressed as "be ethical".
    - 23B1 3y ago
      The lawyers certainly agree with you on that!
codazoda 3y ago
I took a quick peak at this last time it was mentioned and it had dozens of my own repos of unlicensed source code in it. All of that was published on GitHub and made public, but much of it has no license specified.

by sgu999 3y ago

blackeyeblitzar 3y ago

It received DMCA takedowns: https://en.wikipedia.org/wiki/The_Pile_(dataset) https://en.wikipedia.org/wiki/The_Pile_(dataset) > The Books3 component of the dataset contains copyrighted material compiled from Bibliotik, a pirate website. In July 2023, the Rights Alliance took copies of The Pile down through DMCA notices. Users responded by creating copies of The Pile with the offending content removed.

simonw 3y ago

It is absolutely absolutely packed with unlicensed, copyrighted data. Books3 is the most notable example - nearly 200,000 pirated ebooks - but a lot of the rest of it is (unlicensed) scraped web data. The legal questions over whether this is a problem are currently still unresolved. Many people are also bothered by the ethical implications, which is a separate issue from the legal questions.

deleted 3y ago
[deleted]
23B1 3y ago
Ironic that even our everyday governance has little 'Alignment' between ethics and law.
- jacobn 3y ago
  Ethics are a lot more nuanced and change a lot faster than laws. Heck, a large fraction of ethics seem to be so fickle that they’re subject to potential revision by every generation. In fact, I’d argue that those revisions are a significant portion of how one generation distinguishes itself from their parents. Yet strangely every generation feels like they have arrived at a set of “universal laws” in their ethics.
- KarlKemp 3y ago
  In this case, both ethics and the law are murky. Pretty excellent alignment, for once?
- ben_w 3y ago
  We wouldn't need lawyers if all the rules could be expressed as "be ethical".
  - 23B1 3y ago
    The lawyers certainly agree with you on that!

codazoda 3y ago

I took a quick peak at this last time it was mentioned and it had dozens of my own repos of unlicensed source code in it. All of that was published on GitHub and made public, but much of it has no license specified.