This is true but keep in mind that once latency starts to go over ~10ms it starts to become noticeable for a lot of people, and even if it isn't directly notice

This is true but keep in mind that once latency starts to go over ~10ms it starts to become noticeable for a lot of people, and even if it isn't directly noticeable it's likely that VR latency still causes some physiological issues for most people.