4 ms·
The "world model" is still completely, utterly syntactic -- the machine may very well learn that the word "sun" is related to "warm", "light", "day", but cannot
by lou1306 4y ago
The "world model" is still completely, utterly syntactic -- the machine may very well learn that the word "sun" is related to "warm", "light", "day", but cannot ground these words into reality. This is also why it can easily end up making contradictory or inconsistent statements.
- jacknews 4y agoIt's reality is the text it's trained on. That's where the confusion is coming in. Sure it has no idea what the 'sun' is, 'in reality' as you put it. It has not sat under it's heat or seen it's golden glow. But that's our reality. It's reality is the text - it's surely formed a model of the sun from the the billions of words it's ingested, which includes that the sun is hot, has a golden glow at sunset, etc. It has a 'world model', just not one at the same level as ours, and that's why is frequently makes mistakes, from our pov.
- akasakahakada 4y agoAnd surely human do not know what is Sun or what is warm. What human know is electricity spikes come from eyes and skin.
- jacknews 4y agoExactly, the 'sensors' are just at different levels between these models (abstract text) and humans (retinal cones firing, etc).