5 ms·
How would you type? Xbox controller? Leap motion table tapping? Without the ability to input effectively it's a negative hit on productivity for multi monito
by brador 11y ago
How would you type? Xbox controller? Leap motion table tapping? Without the ability to input effectively it's a negative hit on productivity for multi monitor use.
A room full of movies playing is fun, until you see through it.
- return0 11y agoIt's not too hard when seated on your desk with a keyboard and mouse. I wonder how easy it is on the eyes though.
- kbenson 11y agoWhy wouldn't you just track the keyboard, and superimpose it over your virtual desktop when needed? You would want something to track keyboard position and orientation, and your hands. The winner at that point is the ability to phase different aspects of your workspace in and out of view at will, or extra contextual information based on your task, such as an overlay on the keyboard for shortcuts in the current application.
- joeld42 11y agoI'm hoping to try this approach with a digital piano keyboard. Will it be usable if I can see the keys but not see my hands? I'll find out. (I'm not a very good player, I can play without looking at the keys but I still need to glance at them, e.g. when changing position or playing a wide chord) edit to note: I do have a Leap Motion, and I'll try that, too, but right now my plan is to use it above the keyboard as a gesture controller rather than facing down at the keys. Lots of experiments to try. :)
- kbenson 11y agoA leap motion integrated into this to show your hands might work really well. At some point we'll know what's required for a good environment like this, and have software that supports it all. For now, it's new territory.
- lhl 11y agoFor seeing your keyboard, simply turning on the AR layer on head tilt works pretty well. Here's a video of a demo I made last year using that: https://www.youtube.com/watch?v=jNtZmCDyEyU&feature=youtu.be&t=60 https://www.youtube.com/watch?v=jNtZmCDyEyU&feature=youtu.be... Doing virtual tracking would be ideal but neither the Lighthouse or Constellation protocols have been published (you could tape a Vive controller to the keyboard if you wanted to simulate that)
- kbenson 11y agoYeah, something that tried to do a visual mathcing of keyboard and hands and only showed those when you looked down would be idea for data entry (but looking down to see reality has other uses).
- JoshTriplett 11y ago> Why wouldn't you just track the keyboard, and superimpose it over your virtual desktop when needed? There's no substitute for having physical keys your fingers touch. I can't touch-type on a virtual keyboard.
- kbenson 11y agoNo, I'm talking about representing your real keyboard, in it's correct relative space, in your virtual space, so you can correctly use it in reality. If there was a front facing camera on the VR set, you would just pass the image of keyboard and your hands through when in that entry mode, but without that you approximate the keyboard position and the position of your hands (with extra hardware, or a leap motion, etc), and represent them correctly in VR so they can be used as expected.
- JoshTriplett 11y agoAh, I see. Yeah, that makes sense. Doesn't seem necessary if you touch-type, but definitely useful for everyone who doesn't. You'd have to accurately represent your fingers, too, at that point, and with a lot of accuracy to match the user's proprioception. (By comparison, you definitely want a representation of a controller or wand or similar manipulator in-world, so that you can position it spatially.)
- 83457 11y agoif you are a touch typer this is a non issue. I've typed a bunch of rift on and if I really have to see something I just peek under. With that said though there are some projects out there where people try to track fingers on a keyboard with camera or leap motion so you can see they keyboard and type in vr.