That's fair, but on the other hand I can imagine situations where it would be okay. Like maybe one person is working on something and another person is advising

That's fair, but on the other hand I can imagine situations where it would be okay. Like maybe one person is working on something and another person is advising their interactions within the AR. It'd be nice to be able to interact a bit while still leaving the person mostly in the virtual world. I'm thinking about an interaction kind of like the scene in Minority Report where one character is controlling the displays while the other is giving information and interacting with them, but it's not always a face-to-face interaction (https://youtu.be/7SFeCgoep1c https://youtu.be/7SFeCgoep1c). In that sort of situation, this kind of feature seems useful.