By looking, you're forcing it to take a color if it didn't have one. You can't tell if it was randomly chosen by your action, or if it was chosen by the other

By looking, you're forcing it to take a color if it didn't have one. You can't tell if it was randomly chosen by your action, or if it was chosen by the other side's action before yours, without communicating by some other means.