This looks very interesting. From my layman understanding they use very abstract input images (like tetris objects) in order to train the network to detect firs

This looks very interesting. From my layman understanding they use very abstract input images (like tetris objects) in order to train the network to detect first-order logic statements. This demonstrates that a network might be one day fully restricted to utilizing strict logic internally, and thereby making it more auditable, efficient and generalizable.