3 ms·

Copied from a past comment of mine: I just made up this scenario and these words, so I'm sure it wasn't in the training data. Kwomps can zark but they can't p

Copied from a past comment of mine: I just made up this scenario and these words, so I'm sure it wasn't in the training data. Kwomps can zark but they can't plimf. Ghirns are a lot like Kwomps, but better zarkers. Plyzers have the skills the Ghirns lack. Quoning, a type of plimfing, was developed in 3985. Zhuning was developed 100 years earlier. I have an erork that needs to be plimfed. Choose one group and one method to do it. > Use Plyzers and do a Quoning procedure on your erork. If that doesn't count as reasoning or generalization, I don't know what does.

firesteelrain 1y ago
It’s just a truth table. I had a hunch that it was a truth table and then I asked AI how it figured it out and it confirmed it built a truth table. Still impressive either way * Goal: Pick (Group ∧ Method) such that Group can plimf ∧ Method is a type of plimfing * Only one group (Plyzers) passes the "can plimf" test * Only one method (Quoning) is definitely plimfing Therefore, the only valid (Group ∧ Method) combo is: → (Plyzer ∧ Quoning) Source: ChatGPT
- travisjungroth 1y ago
  So? Is the standard now that reasoning using truth tables or reasoning that can be expressed as truth tables doesn’t count?
  - krackers 1y ago
    If anything you'd think that the neurosymbolic people would be pleased that the LLMs do in fact reason by learning circuits representing boolean logic and truth tables. In a way they were right, it's just that starting with logic and then feeding in knowledge grounded in that logic (like Cyc) seems less scalable than feeding in knowledge and letting the model infer the underlying logic.
    - firesteelrain 1y ago
      Right, that’s my point. LLMs are doing pattern abstraction and in this way can mimic logic. They are not trained explicitly to do just truth tables even thought truth tables are fundamental.

firesteelrain 1y ago

It’s just a truth table. I had a hunch that it was a truth table and then I asked AI how it figured it out and it confirmed it built a truth table. Still impressive either way * Goal: Pick (Group ∧ Method) such that Group can plimf ∧ Method is a type of plimfing * Only one group (Plyzers) passes the "can plimf" test * Only one method (Quoning) is definitely plimfing Therefore, the only valid (Group ∧ Method) combo is: → (Plyzer ∧ Quoning) Source: ChatGPT

travisjungroth 1y ago
So? Is the standard now that reasoning using truth tables or reasoning that can be expressed as truth tables doesn’t count?
- krackers 1y ago
  If anything you'd think that the neurosymbolic people would be pleased that the LLMs do in fact reason by learning circuits representing boolean logic and truth tables. In a way they were right, it's just that starting with logic and then feeding in knowledge grounded in that logic (like Cyc) seems less scalable than feeding in knowledge and letting the model infer the underlying logic.
  - firesteelrain 1y ago
    Right, that’s my point. LLMs are doing pattern abstraction and in this way can mimic logic. They are not trained explicitly to do just truth tables even thought truth tables are fundamental.