4 ms·
Let me put it this way: the text in the training corpus may very well contain the objective thought function. But to the LLM, that is indistinguishable from any
by thomastjeffery 3y ago
Let me put it this way: the text in the training corpus may very well contain the objective thought function. But to the LLM, that is indistinguishable from anything else. It's just another set of patterns between tokens.
From the LLM's perspective, there is only "what", and never "why". The "what" may even contain the "why"! Even so, it is always "what" to the LLM's eyes.
There is an objective difference between ideas, expression, and logic in my mind. I can't tell you precisely what that difference is made of, but I'm quite certain that LLMs are missing it.