2 ms·
>> Not at all. LLMs learn by imbibing a mass of relationships as isolated fragments of information. You gotta be careful how you use the word "relation" here b
by YeGoblynQueenne 9d ago
>> Not at all. LLMs learn by imbibing a mass of relationships as isolated fragments of information.
You gotta be careful how you use the word "relation" here because there's an informal meaning (I'm related to my cousin) and a more strict, formal meaning, that is used in computer science e.g. in the "Relational Calculus" etc. In the formal sense, the one relation that LLMs learn during training is the co-occurrence of tokens in a corpus of text, what's called more technically a "collocation" relation. Nothing says that this is enough to play chess, so I'm indeed doubtful that they can.