There will be a popular science book from him coming out, I read a draft a while ago. It will present it all in a digestible way. The do-calculus to me looks a

There will be a popular science book from him coming out, I read a draft a while ago. It will present it all in a digestible way. The do-calculus to me looks a bit cumbersome. I'm not generally attracted to math that doesn't look like math, except if it is nice looking. :-) On a more general level, when I'm building robots, I consider the interface between their minds and the world a Markov blanket. This means that state in the world can only be represented in the robot by learning through its interface by a combination of forward and inverse models. The existence of a physical barrier makes it possible to define information going through it. You might suggest that the world is created by the robot's mind, but that is probably difficult to back with any information criterion. If the robot learns its body, it knows that it is itself who is performing a movement or if it is being pushed. Knowing that it was itself the actor is enough to know the direction of the causal arrow.