3 ms·
I severely doubt that the spiders which crawled the data would go to the trouble of dereferencing and downloading torrents.
by gfaure 3y ago
I severely doubt that the spiders which crawled the data would go to the trouble of dereferencing and downloading torrents.
- msp26 3y agoIt was probably just pdf copies of the book from random a random ddl website.
- pessimizer 3y ago> The complaint lays out in steps why the plaintiffs believe the datasets have illicit origins — in a Meta paper detailing LLaMA, the company points to sources for its training datasets, one of which is called ThePile, which was assembled by a company called EleutherAI. ThePile, the complaint points out, was described in an EleutherAI paper as being put together from “a copy of the contents of the Bibliotik private tracker.” Bibliotik and the other “shadow libraries” listed, says the lawsuit, are “flagrantly illegal.”