3 ms·
Universal grammar only speaks to the ability to parse and form sentences, not to internal logic. That ChatGPT is capable of producing human-like sentences from
by Blikkentrekker 4y ago
Universal grammar only speaks to the ability to parse and form sentences, not to internal logic.
That ChatGPT is capable of producing human-like sentences from pattern recognition without any universal grammar baked in, even if the underlying reasoning might be flawed, goes against the argument of something such as universal grammar existing.
At the very least, it shows that a neural net is capable of parsing and producing coherent grammar without any assistance from universal grammar. It does not prove that humans don't have it, but it does make a compelling case that it's clearly not required for humans to have it either.
- ak_111 4y agoThat ChatGPT is capable of producing human-like sentences from pattern recognition without any universal grammar baked in You didn't address or missed the main point: chatgpt requires something in the order of a trillion tokens to be capable of producing what you mentioned in one language. There are 40 months old babies that are fairly conversant in both Chinese and English, and are able to detect sarcasm with something like 0.0000001% of the tokens, doesn't that give you pause that part of language acquisition is innate to humans and is not entirely acquired the way chatgpt is taught?
- Blikkentrekker 4y agoIt requires so much to be able to generate answers tot hings asked about a wide variety of subjects, not to be able to generate grammatically valid sentences and parse them, which other a.i.'s also did before with far fewer tokens.