3 ms·
I mostly agree with you, but I wonder what's the distance between what you described and our actual intelligence.
by haolez 6y ago
I mostly agree with you, but I wonder what's the distance between what you described and our actual intelligence.
- tsimionescu 6y agoI don't think there is any kind of similarity between a text prediction model and human (or animal) intelligence. At most we maybe have a subsystem that could work somewhat similarly. It's very clear though that human intelligence has a model of the world being made up of agents which interact with objects. Words and sentences refer to entities in this model in our head, and our use of language essentially consists of describing instances of this model, with various purposes. Text prediction works exclusively on text, no model of the world, and it has a single purpose: to produce the text that would be most likely to follow the prompt based on its training. This isn't just a theoretical difference. GPT-3 couldn't be used to, for example, be presented with a situation and asked to respond to it in such a way that it achieves some goal.