3 ms·

The examples you mention work well because there is a real world affordance (the wheel, the act of throwing) that the gesture maps to. I agree that rotating a w

by GuiA 6y ago

The examples you mention work well because there is a real world affordance (the wheel, the act of throwing) that the gesture maps to. I agree that rotating a wheel gesturally makes more sense as an interaction in VR than the same action does with a mouse pointer. The grenade example is a good one, because throwing/flicking doesn't require much feedback, unlike say rotation or fine grained manipulation. Of course the interaction would feel nicer if you could feel the weight of what you're throwing - the physics of throwing objects always feels kind of off in VR games - but it still works well enough. Note that many games did this with the Wiimote, and there is nothing about that interaction that is singular to VR. However, the moment you lose that affordance based in a real world object, and ask your user/player to make gestures in mid air based on recollection, things really do start to fall apart. There is a host of HCI literature/projects around this - e.g. check out papers/demos from the Kinect era. An RPG game like the one you describe could be made with Kinect, and I vaguely recall a few in development - but Kinect demonstrated well that the only kind of gestural interaction that works in long term sessions is dancing. Btw, this is why if you go to e.g. the VR center in Tokyo, almost every booth has physical props for you to hold/grip/sit on while you're fishing/golfing/shooting a gun/riding a bike in VR.

keenmaster 6y ago
I suspect that gesture input adoption, categorically, has emergent properties. Many different things have to "go right" for the input category to take off in a way that is hard to grok. The use of gestures has to appeal to hardcore gamers (in this case). The motion tracking needs to be sufficiently advanced. There can't be a swifter, dopamine enhancing alternative (like mashing buttons on a keyboard). A critical mass of developers need to make games with gestures as a core mechanic. Etc... I offer Pavlov VR as an example. Pavlov is like Counterstrike, except many of the mechanics are gesture based. - You grab your gun off your back - You actually need to look through the scope for zoom, physically bringing your head and hands into alignment - You have to reach over your left shoulder to activate the walkie-talkie for remote communication - Reloading is a multi-step process and varies from gun to gun You might say that I'm proving your point about gestures mapping to real-life, but that's not why I bring up Pavlov. I'm using it to illustrate the aforementioned emergent properties, because all of those gestures add up to something unexpected: even with subpar graphics and a low budget, it is fun. Not only that, but it is fun in an unexpected, novel way for FPS games. Suddenly, your kill count, headshots, etc...don't matter as much. The immersion as well as the social element of the game are huge. You are so zoomed in, so in the moment, when you are in a firefight, poking out your head out to snipe the sniper before rushing back below the barrier, in a way that you wouldn't be in a 2D game. Microsoft could technically have made a Pavlov Kinect, but who would play it? Almost no one. People would complain that traditional controls make much more sense, and they would have a point. It's simply awkward to squirm around in front of a 2D screen. There's a disconnect between the input modality (3D gestures) and the display modality (2D screen) when using the Kinect. In VR, both the input and the display are in 3D harmony.
Miraste 6y ago
The only gesture input the Kinect could recognize reliably was dancing. I don't think that says much about the appeal of gesture controls in a system that can see finer movements. As a counterexample, iOS and MacOS have a lot of gestures which aren't based on real world motions, and people use those all the time.
- GuiA 6y ago
  Kinect offered good full body skeletal tracking. Saying that it could “only recognize dancing” is objectively wrong. And even if that was the issue, look at eg Magic Leap, which had excellent finger tracking. What compelling things were built for it? The issue is that “gestures” are not a binary thing that you do or not; they live on a continuum. What is waving vs raising your hand to swat a fly? Categorizing these “gestures” in a meaningful way and layering effective gameplay on top of it is the challenge, that pretty much no one solved despite the huge incentives. Gestures on two-dimensional multitouch screens are not what we’re talking about here (and even then, you can’t expect people to remember much more beyond the 5/6 core ones).

by GuiA 6y ago

keenmaster 6y ago

I suspect that gesture input adoption, categorically, has emergent properties. Many different things have to "go right" for the input category to take off in a way that is hard to grok. The use of gestures has to appeal to hardcore gamers (in this case). The motion tracking needs to be sufficiently advanced. There can't be a swifter, dopamine enhancing alternative (like mashing buttons on a keyboard). A critical mass of developers need to make games with gestures as a core mechanic. Etc... I offer Pavlov VR as an example. Pavlov is like Counterstrike, except many of the mechanics are gesture based. - You grab your gun off your back - You actually need to look through the scope for zoom, physically bringing your head and hands into alignment - You have to reach over your left shoulder to activate the walkie-talkie for remote communication - Reloading is a multi-step process and varies from gun to gun You might say that I'm proving your point about gestures mapping to real-life, but that's not why I bring up Pavlov. I'm using it to illustrate the aforementioned emergent properties, because all of those gestures add up to something unexpected: even with subpar graphics and a low budget, it is fun. Not only that, but it is fun in an unexpected, novel way for FPS games. Suddenly, your kill count, headshots, etc...don't matter as much. The immersion as well as the social element of the game are huge. You are so zoomed in, so in the moment, when you are in a firefight, poking out your head out to snipe the sniper before rushing back below the barrier, in a way that you wouldn't be in a 2D game. Microsoft could technically have made a Pavlov Kinect, but who would play it? Almost no one. People would complain that traditional controls make much more sense, and they would have a point. It's simply awkward to squirm around in front of a 2D screen. There's a disconnect between the input modality (3D gestures) and the display modality (2D screen) when using the Kinect. In VR, both the input and the display are in 3D harmony.

Miraste 6y ago

The only gesture input the Kinect could recognize reliably was dancing. I don't think that says much about the appeal of gesture controls in a system that can see finer movements. As a counterexample, iOS and MacOS have a lot of gestures which aren't based on real world motions, and people use those all the time.

GuiA 6y ago
Kinect offered good full body skeletal tracking. Saying that it could “only recognize dancing” is objectively wrong. And even if that was the issue, look at eg Magic Leap, which had excellent finger tracking. What compelling things were built for it? The issue is that “gestures” are not a binary thing that you do or not; they live on a continuum. What is waving vs raising your hand to swat a fly? Categorizing these “gestures” in a meaningful way and layering effective gameplay on top of it is the challenge, that pretty much no one solved despite the huge incentives. Gestures on two-dimensional multitouch screens are not what we’re talking about here (and even then, you can’t expect people to remember much more beyond the 5/6 core ones).