4 ms·
The Wikipedia article on garden path sentences has a good description of that phenomenon. https://en.wikipedia.org/wiki/Garden_path_sentence https://en.wikiped
by bendykstra 11y ago
The Wikipedia article on garden path sentences has a good description of that phenomenon.
https://en.wikipedia.org/wiki/Garden_path_sentence https://en.wikipedia.org/wiki/Garden_path_sentence
- wodenokoto 11y agoThank you for the link. I do think we have NLP algorithms that can handle garden paths without understanding the sentence. A state of the art Japanese POS-tagger for example has a dictionary of all previously seen word/pos pairs and their transition probabilities. Sine there are no spaces in Japanese, the possible combinations of word/pos pairs you can lay out that matches the input sentence is quite big, and gives you a fairly large graph that you need to find the globally best path through. This means the algorithm does walk down the garden path, but at some point decides that there is a better path that will get you to the end of the sentence. If you go to http://www.atilika.org http://www.atilika.org, scroll down a bit, select the "viterbi" radio button, paste 私は日本人です into the text box and click tokenise, you can see an example of such a graph.