3 ms·
Assume everyone is familiar with this project, dating back to 1996: https://en.wikipedia.org/wiki/WWWOFFLE https://en.wikipedia.org/wiki/WWWOFFLE https://ftp.
by 1vuio0pswjnm7 2y ago
Assume everyone is familiar with this project, dating back to 1996:
https://en.wikipedia.org/wiki/WWWOFFLE https://en.wikipedia.org/wiki/WWWOFFLE
https://ftp.netbsd.org/pub/pkgsrc/distfiles/wwwoffle-2.9j.tgz https://ftp.netbsd.org/pub/pkgsrc/distfiles/wwwoffle-2.9j.tg...
The way the www is going, it seems like downloading a copy of libgen, i.e., nonfiction books, and scimag, i.e., academic journals, via torrent, would be more valuable than archiving websites, in general. These primary sources are part of the material used to train so-called "AI" anyway. The problem is that this so-called "AI" also includes all the garbage from the www.
Worst case is eventually these books and journals will again become publicly inaccessible but "AI" will be offered as a bogus substitute; a future where few people will do research using primary materials anymore, they will just submit questions to a remote "AI" server. Truth will be decimated.
- dkz999 2y agoWe already kind of see this with search.
- oredbored 2y agoDo we know for sure that they trained on data from libgen etc? It's such a powerful source of information you'd assume they must have, although they would never admit it. There must be a way to test if they have, via enquiring about some niche information only found in certain books.
- Intralexical 2y agoIt is apparently widely suspected that a certain "Books2" dataset mentioned by OpenAI is basically just LibGen: https://blusharkmedia.medium.com/the-ongoing-battle-against-openai-and-the-tumultuous-world-of-ai-book-datasets-b86475e7bf3b https://blusharkmedia.medium.com/the-ongoing-battle-against-... https://techhq.com/2023/09/can-libgen-shadow-library-survive-being-sued-by-textbook-publishers/ https://techhq.com/2023/09/can-libgen-shadow-library-survive... https://www.twitter.com/theshawwn/status/1320282152689336320 https://www.twitter.com/theshawwn/status/1320282152689336320 https://qz.com/openai-books-piracy-microsoft-meta-google-chatgpt-bard-1850757064 https://qz.com/openai-books-piracy-microsoft-meta-google-cha... https://qz.com/shadow-libraries-are-at-the-heart-of-the-mounting-cop-1850621671 https://qz.com/shadow-libraries-are-at-the-heart-of-the-moun... https://goodereader.com/blog/e-book-news/authors-file-lawsuit-against-openai-alleging-using-pirated-content-for-training-chatgpt?doing_wp_cron=1716926858.3886160850524902343750 https://goodereader.com/blog/e-book-news/authors-file-lawsui... When asked about whether this was true, they refused to answer based on confidentiality concerns, then said they had deleted all copies of the dataset, stopped using it, and no longer employed the individuals that compiled it: https://www.businessinsider.com/openai-destroyed-ai-training-datasets-lawsuit-authors-books-copyright-2024-5 https://www.businessinsider.com/openai-destroyed-ai-training... We do know for a fact that the (non-OpenAI-controlled) "Books3" dataset is just "all of bibliotik": https://www.twitter.com/theshawwn/status/1320282149329784833 https://www.twitter.com/theshawwn/status/1320282149329784833 https://github.com/soskek/bookcorpus/issues/27 https://github.com/soskek/bookcorpus/issues/27 And we also apparently know for a fact that this was included in the datasets used to train LLAMA: https://en.wikipedia.org/wiki/The_Pile_(dataset) https://en.wikipedia.org/wiki/The_Pile_(dataset) https://aicopyright.substack.com/p/the-books-used-to-train-llms https://aicopyright.substack.com/p/the-books-used-to-train-l... https://aicopyright.substack.com/p/has-your-book-been-used-to-train https://aicopyright.substack.com/p/has-your-book-been-used-t...
- oredbored 2y agoThanks a lot for all the links. Fascinating stuff.
- 1vuio0pswjnm7 2y agohttps://news.ycombinator.com/item?id=34616256 https://news.ycombinator.com/item?id=34616256 https://news.ycombinator.com/item?id=40258584 https://news.ycombinator.com/item?id=40258584 https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf https://www.wired.com/story/battle-over-books3 https://www.wired.com/story/battle-over-books3 https://www.washingtonpost.com/technology/interactive/2023/ai-chatbot-learning https://www.washingtonpost.com/technology/interactive/2023/a... https://www.theguardian.com/technology/2023/apr/20/fresh-concerns-training-material-ai-systems-facist-pirated-malicious https://www.theguardian.com/technology/2023/apr/20/fresh-con... https://storage.courtlistener.com/recap/gov.uscourts.cand.414822/gov.uscourts.cand.414822.122.0.pdf https://storage.courtlistener.com/recap/gov.uscourts.cand.41... See 40-45. https://storage.courtlistener.com/recap/gov.uscourts.nysd.606655/gov.uscourts.nysd.606655.40.0.pdf https://storage.courtlistener.com/recap/gov.uscourts.nysd.60... See 87-116.
- 1vuio0pswjnm7 2y agoThis "AI" nonsense seems like a legitimate threat to literacy. Why would young people read a nonfiction book when they can just send questions to a so-called "tech" company that has used the book in training a LLM. These companies, needless intermediaries with zero experise on the subject matter of the book, exist only to collect data and use it for commercial purposes. Unlike the books' authors and publishers they have no responsibility for publishing information that is adequately researched and factually correct.
- 1vuio0pswjnm7 2y agos/experise/expertise/