Mechanically there's only three degrees of freedom (translation in the plane and rotation about the optical axis), the cameras just calculate an approximately c

Mechanically there's only three degrees of freedom (translation in the plane and rotation about the optical axis), the cameras just calculate an approximately correct translation for pitch/yaw movements. Pitching or yawing the sensor itself would take it immediately out of the depth of focus (the image side equivalent of depth of field) and the image would be a blurry mess.