I think this sort of works if the operator is familiar with the surroundings, but even then, I can see this being rather annoying for others physically present

I think this sort of works if the operator is familiar with the surroundings, but even then, I can see this being rather annoying for others physically present in the area... Also, I'm not sure what problem this is specifically solving. If the idea is to give you your own point of view, then toy like controls probably won't cut it. They should really look to provide an interface with an AR headset of some kind.