4 ms·
ChatGPT is trained on LibGen, among others, no? To the best of my knowledge, all of these generators are taking mountains of content without asking the creator
by mandmandam 4y ago
ChatGPT is trained on LibGen, among others, no?
To the best of my knowledge, all of these generators are taking mountains of content without asking the creators, aka, pirated materials.
- sometimeshuman 4y agoI often cited example is to write something in the style of "Dr. Suess". Doesn't this imply that Dr. Suess's books are in the training data set ? How can one find out what other books, screenplays, magazines, etc. are in the training data.
- creata 4y ago> Doesn't this imply that Dr. Suess's books are in the training data set ? Or maybe that lots of people online like to write (and challenge each other to write) in the style of Dr. Seuss.
- fnordpiglet 4y agoI’ll wager $10 it falls under fair use.
- dirheist 4y agoIt is, it's libgen + commoncrawl + wikidump + a bunch of other datasets. OpenAI claim that commoncrawl is roughly 60% of its total training corpus and they also claim they use the other datasets listed. They probably also have some sort of proprietary Q&A/search query corpus via Microsoft.
- humanistbot 4y ago> It is, it's libgen + commoncrawl + wikidump + a bunch of other datasets. I'm having trouble finding a source for the libgen claim. Is that confirmed or just rumor?
- mandmandam 4y agoThe ChatGPT Prompt book by LifeArchitect.ai is where I saw it: https://docs.google.com/presentation/d/17b_ocq-GL5lhV_bYSShzUgxL02mtWDoiw9xEroJ5m3Q/edit#slide=id.g1b8e0b333f6_0_124 https://docs.google.com/presentation/d/17b_ocq-GL5lhV_bYSShz...
- dblitt 4y ago> Informed 'best guess' only. > Sources: https://lifearchitect.ai/papers/ https://lifearchitect.ai/papers/ Doesn't seem too convincing to me
- gnopgnip 4y agoCopyright doesn't really factor in what went into the creation, it is about what is published and whether that is infringing
- ygouzerh 4y agoIs it pirated materials if it's publicly accessible ? It's quite similar to someone reading the web
- flangola7 4y agoIt is trained on days from piracy trackers, not just the open web.