3 ms·
That's not the takeaway I got from the "how it works" post. He does describe the word statistics part in detail - which is, of course, pretty fundamental to how
by int_19h 4y ago
That's not the takeaway I got from the "how it works" post. He does describe the word statistics part in detail - which is, of course, pretty fundamental to how it works - but he doesn't claim that it's merely a "stochastic parrot", like many do. On the contrary (highlighting mine):
"... this means that ChatGPT—even with its ultimately straightforward neural net structure—is successfully able to “capture the essence” of human language and the thinking behind it. And moreover, in its training, ChatGPT has somehow “implicitly discovered” whatever regularities in language (and thinking) make this possible."