I looked a little into it. Some of it is indeed built on stuff that is quite old. It seems like they’re doing a vector embedding thing but have operations defin

I looked a little into it. Some of it is indeed built on stuff that is quite old. It seems like they’re doing a vector embedding thing but have operations defined on their embedding space that capture certain symbolic reasoning abilities and allow you to perform reasoning using multiple networks (they have a structured way to combine the output of a color network and a shape network to encode “red triangle” even if the networks don’t know about each other)