4 ms·
Does it have to be "readily available" in order to train on it? For all we know, OpenAI could have pulled down the sci-hub/library genesis libraries and include
by capableweb 4y ago
Does it have to be "readily available" in order to train on it? For all we know, OpenAI could have pulled down the sci-hub/library genesis libraries and included everything from there in the training set.
If they didn't, I hope they do it for GPT5.
- jacquesm 4y agoThat's about 150T, so not beyond the capability of the companies we're talking about. The bigger question is how much real information is encoded in there and how many of the 'leaf' papers (the ones that build on other work but that so far are without further confirmation) are wrong. ChatGPT might give you good answers 9 out of 10 times and kill you on the 10th.