You still need precision even for things that are far away. You don't necessarily care that the building your character is looking at a mile away is exactly in

You still need precision even for things that are far away. You don't necessarily care that the building your character is looking at a mile away is exactly in the right spot, but imprecision causing Z-fighting will be very noticeable as the windows constantly flicker back and forth in front of the facade.