2 ms·
LLMs are text compression algos. They are very good at memorising & retrieving text related to the user input. They can even pass bar exams based on that - some
by garspin 2y ago
LLMs are text compression algos.
They are very good at memorising & retrieving text related to the user input.
They can even pass bar exams based on that - some misinterpret that as intelligence.
However, no amount of scaling will change a text memorisation algo into a symbolic reasoning or composability algo, both of which are necessary for progress towards AGI.
So yes, LLMs are a dead end in the quest for AGI.
However, they have their uses as a google/stackoverflow replacement.