3 ms·
Chomsky's critique of LLMs was somehow not even correct about his own theories (https://x.com/profraha/status/1634311282135318529 https://x.com/profraha/status/
by astrange 2y ago
Chomsky's critique of LLMs was somehow not even correct about his own theories (https://x.com/profraha/status/1634311282135318529 https://x.com/profraha/status/1634311282135318529). And of course has the usual problem of 1. claiming LLMs are random statistical models (they aren't, the sampler is) 2. claiming instead of generating correct text they only "seemingly" generate correct text and not explaining why this is any less impossible.
But people have built explicit grammar knowledge into LLMs (it's in llama.cpp) and nobody seems to need it to make English text.
Of course the main reason Chomsky is a crank is that he's completely convinced he's right about politics despite his unbroken record of endorsing every mass murderer in the world as long as they're anti-American.
- monadINtop 2y ago[flagged]
- optimalsolver 2y agoI swear there's a personality type that simply can't resist injecting their politics into unrelated conversations. It's truly fascinating.
- astrange 2y agoI don't think that the opinion "70s intellectuals' love of the genocidal Khmer Rouge is bad" is "my" politics. I think this is a commonly held opinion actually.
- monadINtop 2y agohttps://www.jstor.org/stable/25006809 https://www.jstor.org/stable/25006809 https://www.counterpunch.org/2021/09/10/noam-chomsky-and-the-khmer-rouge/ https://www.counterpunch.org/2021/09/10/noam-chomsky-and-the... stop spreading lies that have been debunked for decades, not everyone share your inability to parse information from outside your ideological bubble