You don't necessarily need better FPS from the pose tracking, because you can use optical flow to interpolate and predict movement. These sort of techniques are

You don't necessarily need better FPS from the pose tracking, because you can use optical flow to interpolate and predict movement. These sort of techniques are already commonly used for VR positional tracking off camera input.