As another option, perhaps having it passively reorient whenever you look at the same location for a long time. If you stare at a window, then it slowly adjust

As another option, perhaps having it passively reorient whenever you look at the same location for a long time. If you stare at a window, then it slowly adjusts that window to be straight ahead. If done slowly enough, you might be able to trick the wearer's brain into thinking that it hasn't actually moved.