3 ms·
I’ve tried some sci-fi nonsense on GPT-2 in the past and it returned flattened out phpBB replies, complete with usernames and headers. So whatever they are trai
by numpad0 6y ago
I’ve tried some sci-fi nonsense on GPT-2 in the past and it returned flattened out phpBB replies, complete with usernames and headers. So whatever they are trained with must include web crawls.
- minimaxir 6y agoGPT-2 was trained on web links linked to from Reddit which would explain your output. GPT-3 was trained on the Common Crawl + books.