I think this is too critical of LLMs. I do think a lot of people are ignorant on the subject and overhyping the actual power of LLMs, to the point where we're c

I think this is too critical of LLMs. I do think a lot of people are ignorant on the subject and overhyping the actual power of LLMs, to the point where we're calling them AIs, but these are actual emergent abilities. I'm still regularly surprised by how much "intelligence" can be extracted from our language, but I think it makes sense that some of the training would develop emergent abilities like this. A language model should be under pressure to learn addition and how to break down the various ways we state addition in math than to store a broad look-up table that reacts to "5 plus six" as strongly as "6+5".