4 ms·
> not at all what humans do when they think. Parent commentator should probably square with the fact we know little about our own cognition, and it's really an
by stevenhuang 11mo ago
> not at all what humans do when they think.
Parent commentator should probably square with the fact we know little about our own cognition, and it's really an open question how is it we think.
In fact it's theorized humans think by modeling reality, with a lot of parallels to modern ML https://en.wikipedia.org/wiki/Predictive_coding https://en.wikipedia.org/wiki/Predictive_coding
- stavros 11mo agoThat's the issue, we don't really know enough about how LLMs work to say, and we definitely don't know enough about how humans work.
- grey-area 11mo agoWe absolutely do, we know exactly how LLMs work. They generate plausible text from a corpus. They don't accurately reproduce data/text, don't think, they don't have a world view or a world model, and they sometimes generate plausible yet incorrect data.
- stavros 11mo agoHow do they generate the text? Because to me it sounds like "we know how humans work, they make sounds with their mouths, they don't think, have a model of the world..."