3 ms·
I’ve still wondered if anyone has tried training with a large dataset of published books, like something from library genesis, or in the case of google using th
by TaylorAlexander 3y ago
I’ve still wondered if anyone has tried training with a large dataset of published books, like something from library genesis, or in the case of google using the full text from google books. There’s all this talk of finding quality text and I’ve not heard of text from print books being a major source beyond this textbooks paper?
- startupsfail 3y agoThat’s how OpenAI was (is) doing it. Books downloaded from the Internet is a part of the dataset as per GPT3 model card. Right to read.