3 ms·
I don't think this paper is very useful. The author is from the OpenCog group, who have spent years building a structured knowledge base as a predecessor to bu
by nl 12y ago
I don't think this paper is very useful.
The author is from the OpenCog group, who have spent years building a structured knowledge base as a predecessor to building an artificial general intelligence. It isn't clear how AGI emerges from this work.
The OpenCog KB is a useful piece of work, but it's interesting to note that word/phrase embedding models (word2vec etc) can give similar or better results on most practical tasks that you'd use OpenCog for.
My view is that Deep Learning techniques are insufficient for an AGI, but are good candidates for component parts in the same way that the human optical system does significant preprocessing before hitting the "intelligent" brain.
Also thing like memory networks specifically address some of the episodic memory issues the author raised.
- ilaksh 12y ago'Structured knowledgebase' is a completely ridiculous and inaccurate way to characterize probabalistic logic networks and the OpenCog component architecture.
- nl 12y agoPSL isn't magic. It's just a way to do reasoning taking probability and/or confidence into account. I'd note that Stanford's DeepDive explicitly claims to be a KB building tool, despite it doing probabilistic inference. In their case they do Gibbs sampling instead of PSL, but the similarities are clear. Also, people associated with OpenCog (including the author of this paper) often refer to OpenCog knowledge bases. Eg https://opencog.wordpress.com/2008/09/14/progress-update/ https://opencog.wordpress.com/2008/09/14/progress-update/
- ilaksh 12y agoIt is a deceptive description. I said PLN not PSL.
- Animats 12y ago"I don't think this paper is very useful." That's probably correct. The author discusses a known problem; those mis-labeled images are well known, and have been discussed on HN before. It's clear that feature extraction in deep learning sometimes fastens on irrelevant features that somehow work. Some algorithms result in models where data points are too close to at least one decision boundary in a high-dimensional space, which makes them brittle when faced with small, noise-type changes. I don't know enough about the subject to know how that will be fixed, but there are people working the problem and they don't seem to be stuck. Then the author, who is from OpenCog, goes on to claim, without supporting evidence, that OpenCog can somehow fix the problem. The paper proposed an "internal image grammar", but doesn't say much about what they mean by that or how to do it. Trying to decompose images into some symbolic representation has a long, disappointing history. The computational neural network people are getting results without doing that. I think we're reading a grant proposal here.
- nl 12y agoRegarding the internal image grammar: I know some people working using everyday knowledge to attempt to do better image labeling. The idea is that a tree is much more likely to appear in a park than in a kitchen, so you can bias the probable interpretations using that. I guess that's what they could be talking about. But you need a CNN to get the basic partial label in the first place.
- deleted 12y ago[deleted]