3 ms·

I suspect the next user interface revolution will be to use an AI camera to recognize your hand gesture movements to manipulate windows. And to recognize your

I suspect the next user interface revolution will be to use an AI camera to recognize your hand gesture movements to manipulate windows. And to recognize your facial gestures to pop up an interactive helper like Clippy.

deltron3030 7y ago
Nah, AI will calibrate and then calculate your bone movement by measuring tiny vibrations through earphones. Every moving part of you body could be measurable that way. And why would you move your hands if you don't directly interact with objects, you could track your tongue touching or sliding along your teeth, best interface ever.
- rfurmani 7y ago
  I’d that doable? Is there a proof-of-concept? It would be an incredible interface, even if it just recognized some basic hand gestures using a bracelet.
  - deltron3030 7y ago
    Like this? https://youtube.com/watch?v=9HD6WkEgip0 https://youtube.com/watch?v=9HD6WkEgip0
- blackrock 7y ago
  That would be pretty slick indeed. Although it might prematurely wear out my gums and enamels. But then, what if you have a sudden gag reflex? Or a random epileptic seizure? And the AI thinks you want to do a format /f c:, or a rm -rf / command? Hmm.. the OS had better firewall off those special commands.
  - deltron3030 7y ago
    You might have to get used to it, like with speaking. And yes, a safety net that's already baked into your workflow could prevent bad consequences from potential input errors. Use trash instead of rm -rf for example, it makes sure that files you remove land in your trash bin. Look this program up if you don't already use it, seriously.
saberdancer 7y ago
Oculus Quest (standalone VR headset) has released hand tracking as a beta feature. It works surprisingly well but there needs to be a lot of work on designing proper UX for this type of input. For example, pressing a button in VR or on screen is hard to do if your hands are in the air, Oculus so far is using something they call "passive haptics" which is in fact instead of pressing a button in real life, you tap one of your fingers on part of your body/hand. For example to "click" you tap your thumb and your finger. The technology is there.
vitorgrs 7y ago
You can control windows with your eyes https://www.youtube.com/watch?v=6mBlgcnqttg https://www.youtube.com/watch?v=6mBlgcnqttg

deltron3030 7y ago

Nah, AI will calibrate and then calculate your bone movement by measuring tiny vibrations through earphones. Every moving part of you body could be measurable that way. And why would you move your hands if you don't directly interact with objects, you could track your tongue touching or sliding along your teeth, best interface ever.

rfurmani 7y ago
I’d that doable? Is there a proof-of-concept? It would be an incredible interface, even if it just recognized some basic hand gestures using a bracelet.
- deltron3030 7y ago
  Like this? https://youtube.com/watch?v=9HD6WkEgip0 https://youtube.com/watch?v=9HD6WkEgip0
blackrock 7y ago
That would be pretty slick indeed. Although it might prematurely wear out my gums and enamels. But then, what if you have a sudden gag reflex? Or a random epileptic seizure? And the AI thinks you want to do a format /f c:, or a rm -rf / command? Hmm.. the OS had better firewall off those special commands.
- deltron3030 7y ago
  You might have to get used to it, like with speaking. And yes, a safety net that's already baked into your workflow could prevent bad consequences from potential input errors. Use trash instead of rm -rf for example, it makes sure that files you remove land in your trash bin. Look this program up if you don't already use it, seriously.

saberdancer 7y ago

Oculus Quest (standalone VR headset) has released hand tracking as a beta feature. It works surprisingly well but there needs to be a lot of work on designing proper UX for this type of input. For example, pressing a button in VR or on screen is hard to do if your hands are in the air, Oculus so far is using something they call "passive haptics" which is in fact instead of pressing a button in real life, you tap one of your fingers on part of your body/hand. For example to "click" you tap your thumb and your finger. The technology is there.

vitorgrs 7y ago

You can control windows with your eyes https://www.youtube.com/watch?v=6mBlgcnqttg https://www.youtube.com/watch?v=6mBlgcnqttg