3 ms·
'Reasoning' (as in deriving new statements with precision, following logical inference rules) is precisely what the large language models can't do. It's better
by TuringTest 3y ago
'Reasoning' (as in deriving new statements with precision, following logical inference rules) is precisely what the large language models can't do.
It's better to think of this models as 'generating' chains of relevant words, where 'relevant' is defined by similarity of those areas of knowledge on which it has been trained, and which are "activated" as close to the topics in the prompt. Which is not at all dissimilar to how humans learn about a new topic, btw.
This way, by "activating" concepts of areas of knowledge and finding words that are more likely than others to fit those concepts, the model is able to create texts following the constraints you instruct it with - such as poems that rhyme, or critical analysis of scientific articles.
The most important point to be aware of is that this creation model is completely different to how automatic reasoning models create content, which is by having a formal representation of a knowledge domain and creating logical inferences that can be mathematically proven correct within the model. A reasoning model cannot lie, but it cannot create content beyond the logical implications of its premises; its quite the opposite of what language models do.