4 ms·
Isn't r/AskDocs in the corpus on which ChatGPT was trained on the first place?
by sorokod 4y ago
Isn't r/AskDocs in the corpus on which ChatGPT was trained on the first place?
- PrimeMcFly 4y agoIt probably used that more to figure out how to word sentences, but I assumed it relied more on wiki or academic articles to diagnose.
- sorokod 4y agoWhy would it be more probable and why would you assume "wiki" and "academic articles"?
- PrimeMcFly 4y agoNot sure why you put those things in quotes, that's kind of strange. That aside, the training isn't blind, it's guided, and it's likely they use verified correct sources of info to train for some things, like medical diagnoses.
- sorokod 4y agoI can help with "verified correct sources", have a look at "Language Models are Few-Shot Learners" section 2.2 [1]. You may also be interested in Apendix A in the same document: "Details of Common Crawl Filtering" [1] https://arxiv.org/pdf/2005.14165.pdf https://arxiv.org/pdf/2005.14165.pdf