The highest scoring entry used a deep neural network: https://www.cc.gatech.edu/~alanwags/DLAI2016/(Liu+)%20IJCAI-16%20DLAI%20WS.pdf https://www.cc.gatech.edu/~

The highest scoring entry used a deep neural network: https://www.cc.gatech.edu/~alanwags/DLAI2016/(Liu+)%20IJCAI-16%20DLAI%20WS.pdf https://www.cc.gatech.edu/~alanwags/DLAI2016/(Liu+)%20IJCAI-... I'd say it's not doing great because deep learning here merely observes the statistical co-occurrence of words, and hence are only correct insofar as the sentences are common. I'm sure with more data they could get a good 75% of it right. More of a problem is that pure textual comparison is oblivious to the underlying logic. Sometimes the verbs may correlate as a common sequence of events, but a preposition like "in" denotes a logical physical constraint that should overrule the mere correlation of verbs.