3 ms·
So we need to do more Good Old Fashioned AI, and get off my lawn. He has a good point that model-less LLMs have serious trouble with problems that require a mo
by Animats 2y ago
So we need to do more Good Old Fashioned AI, and get off my lawn.
He has a good point that model-less LLMs have serious trouble with problems that require a model.
But predicate calculus hasn't worked out well as that model.
Many years ago, I took John McCarthy's "Epistemological problems in artificial intelligence" class. He laid out the missionary and cannibals problem informally, then wrote it up in a predicate-calculus notation, and then applied his "circumscription logic"[1]. As he wrote it up in his formulation, I thought "and then a miracle occurs".[2] As with most story problems, it's getting the problem into the correct formalism that's hard. Turning the crank on the formalism is usually straightforward.
Much of the AI community spent the 1980s beating on this problem. A large number of very smart people tried to solve it. Many things were tried that were less rigid than predicate calculus - probabilistic logic, Markov chains, fuzzy logic, etc. All mostly failed. The AI Winter followed.
The classic critique in this area is "Artificial Intelligence meets Natural Stupidity", by Drew McDermott.[3] That's from 1976, and still relevant to this argument.
LLMs, though, might be able to use such models. Something to try: put a story problem into an LLM, and ask it what formal methods might help solve this problem. Then ask it to convert the problem into each of those formal methods. Then use something like Mathematica on each formal method. LLMs can't do logic problems, but they can sort of write code and translate between languages. So maybe they can do the miracle part. Anybody working on this?
[1] https://en.wikipedia.org/wiki/Circumscription_(logic) https://en.wikipedia.org/wiki/Circumscription_(logic)
[2] https://trevor-hopkins.com/fiction/miracle2.jpg https://trevor-hopkins.com/fiction/miracle2.jpg
[3] file:///home/john/Downloads/Artificial_Intelligence_meets_natural_stupidity-2.pdf
- garymarcus 2y agoeasier said than done, in the general case. the work I describe in the essay does it in a narrow case, but see also https://garymarcus.substack.com/p/getting-gpt-to-work-with-external https://garymarcus.substack.com/p/getting-gpt-to-work-with-e...
- sbierwagen 2y ago>Then ask it to convert the problem into each of those formal methods. Then use something like Mathematica on each formal method. Draft, Sketch, and Prove from 2022 does something like this: https://arxiv.org/abs/2210.12283 https://arxiv.org/abs/2210.12283
- godelski 2y ago> [3] file:///home/john/Downloads/Artificial_Intelligence_meets_natural_stupidity-2.pdf I'm unsure if this is a meta joke or a great bit of irony. > Anybody working on this? If I understand your question accurately, yes. A more common example is people will ask GPT to answer via python code and then convert the python code into something else. But there are other people doing things more direct and through other methods. There are also people doing things like generating many answers, then performing search over those solutions (with or without GPT). But regardless of, I think you should take care in calling out the "and then a miracle occurs"[0]. While the critique is well deserved, I think the context is dubious. It implies the same magic step is not necessary for LLMs. There's still a gap from where we are and getting to actual intelligence. LLMs are certainly impressive and have done a lot (something I think Gary ignores) but how to get to intelligence is still unknown and thus a missing middle step that "requires a miracle". I don't think there is an issue in people pursuing neurosymbolics. In fact I would encourage it. Just as I'd encourage pursuing LLMs, category theory approaches, and others. The thing I would discourage is putting all our eggs in one basket when we recognize there is a missing step that we don't yet know how to solve. Allocate more resources to what's made the most improvements so far, but also not at the cost of recognizing limitations/criticisms. All technologies have limits and can be improved. It's the naive that reject critiques and the naive that are quick to dismiss. That's not science, that's politics. [0] Variation: https://www.youtube.com/watch?v=a5ih_TQWqCA https://www.youtube.com/watch?v=a5ih_TQWqCA
- Animats 2y agoGood point. Better links. It's a famous paper. [1] https://www.researchgate.net/profile/Drew-Mcdermott/publication/234784524_Artificial_Intelligence_meets_natural_stupidity/links/5408b37e0cf2822fb7366159/Artificial-Intelligence-meets-natural-stupidity.pdf https://www.researchgate.net/profile/Drew-Mcdermott/publicat... [2] https://cs.fit.edu/~kgallagher/Schtick/Serious/McDermott.AI.MeetsNaturalStupidity.pdf https://cs.fit.edu/~kgallagher/Schtick/Serious/McDermott.AI....
- Animats 2y ago> It implies the same magic step is not necessary for LLMs. LLMs can at least take in an informal problem statement and do something semi-useful with it. This is progress. Some other internal representations are needed, especially for dealing with the real world. Pictures? Animations? Animation storyboards? Graphs? Programs? All of the above? Ten years ago it would have been a fantasy to consider pictures and animations as intermediate representations in an AI system. Not any more. Automated storyboard generation is already a thing.