3 ms·

> I'm not making the argument that "they are just like humans", though. I'm merely making the argument that I don't know that they don't understand. They don'

> I'm not making the argument that "they are just like humans", though. I'm merely making the argument that I don't know that they don't understand. They don't understand precisely because they don't act like humans, which is the only source of intuition for the word "understand". > I could make the converse argument for someone shown a sample of the successes, though. It's the routine mistakes that "reveals" that there is no understanding. By your logic you can point to a single success and declare that as proof of understanding. No ordinary person would agree. A teacher who sees a student regularly make errors in reasoning on an exam doesn't say the student "understands" the material. > It seems unfair to judge "understanding" just by what the system can't do, and not by what it can do, I'm not talking about "fair" (whatever that is supposed to mean in this context) I'm talking about an ordinary person's intuition about the word "understand".

stavros 3y ago
> They don't understand precisely because they don't act like humans, which is the only source of intuition for the word "understand". Or it was, until LLMs came along. Unless your definition of the word "understand" is a tautological "understanding is what only humans do because humans are the only ones who understand". > A teacher who sees a student regularly make errors in reasoning on an exam doesn't say the student "understands" the material. Ah, so you don't mean they're unable of understanding in general, but have not understood specific things they make mistakes about? Maybe we can agree there, although I'm still not sure that all mistakes are the same, in the same way that someone being bad at spelling physics terms doesn't mean they don't understand the physics itself.