The thing is, just because it's theoretically possible to interface "naturally", that doesn't mean it will feel natural. Much like interacting with voice-based

The thing is, just because it's theoretically possible to interface "naturally", that doesn't mean it will feel natural. Much like interacting with voice-based assistants is stilted, constrained, and often awkward with misunderstandings and false starts. Interactive VR will be no different. Either it will be very simple but entirely artificial, or it will be complex and "natural" but ultimately unsatisfying. We are nowhere near being able to implement anything approaching "reality". But even if we were, I think you overstate the promise. "Having to learn a new UI" is exactly what you will always have to do to learn to do anything new, whether it's in a mobile app, on a computer, in VR, or in the real world with physical objects. Guitars, power tools, ping pong tables, pressure cookers... they all have new and different user interfaces.