4 ms·

What happens in every LLM: a token predictor that tries to predict the most likely token. It does not have the capacity to logically reason; it tries to derive

What happens in every LLM: a token predictor that tries to predict the most likely token. It does not have the capacity to logically reason; it tries to derive this problem through models that either lack sufficient training data (because how many instances of similar problems would this really have been trained with) or have underfit models. Given enough samples or sufficient language understanding it may provide the right answers, but the "prodding" that you suggested in no way shows that there's semantic understanding happening.

logicallee 4y ago
How about this example? https://imgur.com/a/FSC9gAJ https://imgur.com/a/FSC9gAJ Seems convincing to me, and at the end I have it demonstrate its understanding. It also accurately reports when it is stumped and "still trying to understand" but can't.
- Daishiman 4y ago
  I’m sorry but the absurd length of text and wrong answers it had to go through suggests precisely that it has extremely limited semantic knowledge and a limited association of concepts.
  - logicallee 4y ago
    Sure: the whole point was to get it to figure out something difficult. (It couldn't.) But in the middle of the conversation, why does it accurately report "I'm sorry, but I am still unable to understand the context and the puzzle without more information"? Wouldn't something that just strings words together without understanding, continue stringing words together without accurately reporting that it doesn't understand? Once it does understand, why does it clearly show its understanding, including creating another example of the puzzle and a counterexample: https://news.ycombinator.com/item?id=34423636 https://news.ycombinator.com/item?id=34423636 Clearly this shows understanding.
- roflyear 4y ago
  Make up a simple grammar and try to teach it to ChatGPT. You cannot.
  - logicallee 4y ago
    You're right, I tried it and it didn't learn a simple grammar.

logicallee 4y ago

How about this example? https://imgur.com/a/FSC9gAJ https://imgur.com/a/FSC9gAJ Seems convincing to me, and at the end I have it demonstrate its understanding. It also accurately reports when it is stumped and "still trying to understand" but can't.

Daishiman 4y ago
I’m sorry but the absurd length of text and wrong answers it had to go through suggests precisely that it has extremely limited semantic knowledge and a limited association of concepts.
- logicallee 4y ago
  Sure: the whole point was to get it to figure out something difficult. (It couldn't.) But in the middle of the conversation, why does it accurately report "I'm sorry, but I am still unable to understand the context and the puzzle without more information"? Wouldn't something that just strings words together without understanding, continue stringing words together without accurately reporting that it doesn't understand? Once it does understand, why does it clearly show its understanding, including creating another example of the puzzle and a counterexample: https://news.ycombinator.com/item?id=34423636 https://news.ycombinator.com/item?id=34423636 Clearly this shows understanding.
roflyear 4y ago
Make up a simple grammar and try to teach it to ChatGPT. You cannot.
- logicallee 4y ago
  You're right, I tried it and it didn't learn a simple grammar.