3 ms·
> What is the "deep reasoning" that leads one to the conclusion that a language model is capable of any kind of insight? That almost all of the failures one no
by pessimizer 4y ago
> What is the "deep reasoning" that leads one to the conclusion that a language model is capable of any kind of insight?
That almost all of the failures one notices with them are failures to drag along and maintain/update state? To me, that's just a lack of scaffolding. If LLMs can't add, give them calculators.
I feel outdated even saying this. Certainly people are quickly coming up with dozens of elaborate ways for LLMs to build and update state. They're just not releasing them.
- alienicecream 4y agoIt doesn't know how to store and transform the state, it knows symbols but it doesn't know their meaning so how is it going to transform the state? How is it going to know what the state and limits of objects are or the state and limits of concepts are? It's there a way around that without ushering in complete nonsense? These models are an attempt to circumvent the issue. It's a gorilla in a suit with a team of researchers that are trying to make it look like a person.