Copied from Reddit FYI. As the second author of the paper, I have to say "Wrong Guess", :), we didn't try the other 18. The story is as follows. We had this id

Copied from Reddit FYI. As the second author of the paper, I have to say "Wrong Guess", :), we didn't try the other 18. The story is as follows. We had this idea in early March as a reasoning component of our bigger (and cool) neural system. In early May my student intern (the first author) decided to implement it, but he said "why don't we try this on a couple of hard bAbi tasks on which Memory Net failed？", and then we are here. That said, I don't mean Neural Reasoner can easily solve them without any model tweaking, considering some of them are formulated slightly differently from the two we tried . But more importantly, it was never our goal to nail an artificial data set.