3 ms·
I have a hard time putting it to words, but I do feel that while computers are pretty good at statistically parsing language, humans have an extra sanity check
by wodenokoto 11y ago
I have a hard time putting it to words, but I do feel that while computers are pretty good at statistically parsing language, humans have an extra sanity check that parses "meaning" (what ever that may satisfactionally be defined as).
Maybe it means we need to hook up our NLP pipeline to deep-visual networks and knowledge-graphs in order to ask "Did the message of that sentence make sense, and if not, should check a similarly sounding sentence or a different parsing of the sentence in order to make it more cohesive"
- bendykstra 11y agoThe Wikipedia article on garden path sentences has a good description of that phenomenon. https://en.wikipedia.org/wiki/Garden_path_sentence https://en.wikipedia.org/wiki/Garden_path_sentence
- wodenokoto 11y agoThank you for the link. I do think we have NLP algorithms that can handle garden paths without understanding the sentence. A state of the art Japanese POS-tagger for example has a dictionary of all previously seen word/pos pairs and their transition probabilities. Sine there are no spaces in Japanese, the possible combinations of word/pos pairs you can lay out that matches the input sentence is quite big, and gives you a fairly large graph that you need to find the globally best path through. This means the algorithm does walk down the garden path, but at some point decides that there is a better path that will get you to the end of the sentence. If you go to http://www.atilika.org http://www.atilika.org, scroll down a bit, select the "viterbi" radio button, paste 私は日本人です into the text box and click tokenise, you can see an example of such a graph.
- n0us 11y agoI agree that great advances can be made from statistically parsing language but it is another thing entirely to have a computer (for example) read all of Shakespeare's sonnets and write an essay about the influence they have had on other authors. Even if it is as a highschool level. I kind of see statistical parsing as another "parlor trick" type of AI. Impressive and hard to achieve but somehow separate from true intelligence. It's hard to formally describe this distinction which is why I think that advances will come from cross cutting academic departments and reaching out from the "throw more math and more processors at the problem approach" To achieve a true AI we will have to advance not just our understanding of algorithms, but our understanding of what it means to be intelligent which is a concept that I think most people lack any coherent definition of.