2 ms·
GPT-3 isn't doing any thinking here. It's a glorified Markov Chain trained on the corpus of Reddit. Its output is pieces of random Reddit comments, mixed and ma
by TeMPOraL 6y ago
GPT-3 isn't doing any thinking here. It's a glorified Markov Chain trained on the corpus of Reddit. Its output is pieces of random Reddit comments, mixed and matched to maximize the metric of "how likely are such words to appear after the prompt given".
- Tenoke 6y agoIt's neither anywhere as simple as a Markov Chain nor is the training dataset reddit comments (tho there are some in there).