4 ms·
GPT is trained on Wikipedia though. It’s speculated libgen is in there as well.
by r3trohack3r 4y ago
GPT is trained on Wikipedia though.
It’s speculated libgen is in there as well.
- artificial 4y agoLet’s not forget Twitter was a training source. Early Twitter was like 4chan.
- jvanderbot 4y agoI think GGP comment started this thread about a knowledge engine, not a "word generator" if that makes sense. Training on Wikipedia in this case means "training to put together words like wikipedia authors do" right? Not "learning the facts of wikipedia to provide useful synthesis and cross referencing." though it probably does OK by accident.