3 ms·
My comment got eaten by HN, but I think LLMs should be used as the glue between logic systems like prolog, with inductive, deductive and abductive reasoning bei
by sitkack 2y ago
My comment got eaten by HN, but I think LLMs should be used as the glue between logic systems like prolog, with inductive, deductive and abductive reasoning being handed off to a tool. LLMs are great at pattern matching, but forcing them to reason seems like an out of envelope use.
Prolog would be how I would solve puzzles like that as well. It is like calling someone weak for using a spreadsheet or a calculator.
Abductive Commonsense Reasoning Exploiting Mutually Exclusive Explanations
https://arxiv.org/abs/2305.14618 https://arxiv.org/abs/2305.14618
- nithril 2y agoIt seems quite logical to me as well. An LLM is not a logical computing system but it has the knowledge on how to do a multiplication
- unification_fan 2y agoI've been saying this ever since GPT 3 came out and I started toying with it. It's unfortunate that for all the people who work in AI most of them barely even know what Prolog is.
- astrange 2y agoI actually coincidentally tried this yesterday on variants of the "surgeon can't operate on boy" puzzle. It didn't help, LLMs still can't reliably solve it. (All current commercial LLMs are badly overfit on this puzzle, so if you try changing parts of it they'll get stuck and try to give the original answer in ways that don't make sense.)