4 ms·
It seems I'd gotten the wrong impression of how it works. Do you have any recommendations for primers on GPT and similar systems? Most content seems to be eithe
by underwater 4y ago
It seems I'd gotten the wrong impression of how it works. Do you have any recommendations for primers on GPT and similar systems? Most content seems to be either surface level or technical and opaque.
- fjkdlsjflkds 4y agoNo. You got the right impression. It is indeed doing "next token prediction" in an autoregressive way, over and over again. The best source would be the GPT-3 paper itself: https://paperswithcode.com/method/gpt-3 https://paperswithcode.com/method/gpt-3