Thanks a lot for the links. They look quite interesting. It does seem that Deepmind is aware of this, and are working on evaluating this. Transitivity might be

Thanks a lot for the links. They look quite interesting. It does seem that Deepmind is aware of this, and are working on evaluating this. Transitivity might be true within AlphaGo versions, but that doesn't give me any confidence that it would also hold when a human is in the equation. If a group of policies more or less occupy the same state space, they are likely to be transitive, but if they occupy disjoint state spaces, I don't think we can be sure of transitivity.