3 ms·
FTR I am firmly of the opinion that LLMs are not the pathway to AGI - they work by word association, albeit at sentence/paragraph level, which does not require
by awesome_dude 9mo ago
FTR I am firmly of the opinion that LLMs are not the pathway to AGI - they work by word association, albeit at sentence/paragraph level, which does not require understanding of the words.
To put it in layman's terms
If I have words like jhgjkhg and kjhgsd (etc) and I know that the former always precedes the latter, with a spacing of 3 or 4 words, then I know to use those words at that spacing, and have an understanding of what words can go in the middle.
But at no point have I deciphered what those words mean, nor will I ever.
This differs from humans who have a central understanding of the meaning of a word.
That core understanding is where LLMs are failing and where I believe AGI lives.
How this will be achieved, or proved, I have NFI - I have long given up on ML as a pathway to AGI, and even if it was I don't think that I possess the skills/knowledge/creativity required to help find it.