44 ms·
>> Generally speaking, logical modelling is too limited for good concept representations In principle, First Order Logic and equivalent languages can represent
by YeGoblynQueenne 8y ago
>> Generally speaking, logical modelling is too limited for good concept representations
In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. The problem is that in practice it is very hard to transfer into a logic language all the knowledge you might need for a useful system.
In fact, this was one motivation for at least one branch of machine learning- the work from Ryszard Michalski, Claude Sammut, Ranan Banerji, Steven Vere, Brian Cohen and later rule-learners like Quinlan's decision tree learners and of course all the later work in Inductive Logic Programming by Plotkin, Shapiro, Muggleton etc. These are all rule-learning systems, that can avoid the knowledge acquisition bottleneck that probably did in for purely rule-based expert systems in the '90s (i.e. getting experts to transfer their knowledge into rules).
I rather agree that further progress in AI will require a, let's say, synchretistic approach- like I say in another comment, the obvious thing for me is to use deep learning for perception, logic for inference and probabilistic modelling to deal with the noisy world. There are some people working in that sort of direction, with different amounts of emphasis on each of the three approaches. For instance, Josh Tenenbaum at MIT, Evans and Grefenstette at DeepMind, Luc De Raedt at KU Leuven, Kristian Kersting at Dortmund, Lise Getoor also at MIT, Pedro Domingos at Washington, and many others.
Apologies for all the name-dropping without links. Let me know and I can provide them if required.
- TheOtherHobbes 8y agoI suspect you may have a hard time representing all the implications, subtexts, and allusions in a play by Shakespeare with First Order Logic. It seems more likely that First Order Logic can be represented by a subset of natural language. Otherwise, I agree. I don't understand why everyone has been concentrating so hard on probabilistic ML when there are many applications where inductive inference is more efficient and powerful.
- garmaine 8y agoThat’s not obvious. Do you have any reason for thinking so?
- paganel 8y ago> In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. Is there any proof about an existing non-leaky abstraction between natural language and First Order Logic (or logic in general)? Afaik there is none, but I might me wrong. For example (one amongst thousands): “I don’t like you” can actually mean (and it often does) the exact opposite, and the same can be said of a simple statement like “I am ok” which also can mean the exact opposite. Natural language is a very hard problem.
- narag 8y agoDoes it matter, though? Understanding sarcasm or other forms of language twisting seems like only important for a very advanced and specific set of applications. There's another post in the front page about the death of a gorilla that was able to do signs language. I'm sure nobody cared if he could catch jokes.
- YeGoblynQueenne 8y agoWell, going by formal language theory, FOL is equivalent to a universal Turing machine, which is probably also the full expressive power of human language. Therefore, everything that can be said in human language should in principle be possible to say in FOL. I don't think this is controversial. Notice again that I don't think this is feasible in practice. At least not with hand-crafted FOL expressions and certainly not with existing technology. I'm not sure what "non-leaky abstraction" means. Would formal language theory fit the bill?
- sgt101 8y agoYeah but humans don't have a single consistent logical model for all reasoning - i believe that all my models can be in fol, but i don't believe that they can be unified in fol
- polkapolka 8y agoDennett aims to solve this using heterophenemenology: https://en.m.wikipedia.org/wiki/Heterophenomenology https://en.m.wikipedia.org/wiki/Heterophenomenology In this framework, utterances can be studied without taking their truth value at face value.
- goatlover 8y ago> In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. I doubt this is the case since natural language makes a lot of use of metaphors, and our concepts are probably mostly based on the types of bodies we have and how we interact with the world. See embodied cognition and writings of Lakoff and Mark Johnson.
- sgt101 8y agoIn principle, but not consistently over various cases. Wikipedia shows some examples where it breaks down
- garmaine 8y agoLook into the field of computational semantics. There is absolutely nothing in your comment which cannot be represented in existing logics. Metaphors and such are no problem. There is ambiguity in natural languages so the determination of underlying meaning is at best probabilistic, but we have ways of handling that too.
- randcraw 8y agoLexical and computational semantics may be superior to FOL, (for machine translation, at least) but they've been around now for a very long time without showing much promise toward thawing past AI Winters. I've not heard anyone propose their adoption as the missing next step toward modeling general knowledge across all AI problem spaces. In fact, populating a LS/CS knowledgebase with requisite facts was a game stopper when they were first invented and still pose challenges of scale that remain unsolved decades later. If it accomplished anything, Cyc proved that manual curation alone of a rich database of propositions is depressingly infeasible. So how does one automatically curate a general fact KB, no matter what semantic model the facts take? I don't think expressiveness of the propositional representation will ever decide that question.
- garmaine 8y agoI’m not sure what you are saying. Computational semantics parses sentences to possible interpretations in first order, or higher order logics. It is not some sort of alternative to FOL. And it is still a rapidly developing field.
- bglazer 8y agoI agree totally that a "non-pure" deep learning approach is going to be necessary in pushing the field forward. World shattering results from new deep architectures like AlexNet are becoming more and more rare and improvements are becoming incremental. Language models, for example, showed some impressive results in recent years, but we're still a long long way from generating realistic and useful text. I'm not sure if throwing more data at larger architectures will get us there. Maybe, maybe not. The work by Tenenbaum at MIT is a particularly interesting mix of psychology, computational statistics, and neuroscience. It really challenges the commonly repeated notion that neural networks are completely unrelated to actual brains.
- Eridrus 8y agoOne problem with first order logic is that it is too powerful. There is a direct trade-off between the expressiveness of your representation and your ability to reason about it.
- jryanwelsh 8y agoI'm going to assume you mean the computational complexity of working with such an expressive representation. If so, then that is correct. historically, working such an expressive representation blows out computationally. But, we've resolved that issue with our graph engine. that is, its been shown that algorithms take time proportional to N-cubed where N is the number of graphs in the knowledge base. with our graph engine, we encode graph structures and ontology in a Cognitive Signature, and we can find closely matching signatures in log(N) time. the log-time algorithms scale to the size of the web.
- rwnspace 8y ago>In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language If you include a semantics for supervaluationism (Sorites paradox, Keefe on vagueness)! Thinking of it, I'd love to train a NN against human responses to '"is this a heap, yes/no?" +/-1 grain, repeat'.