4 ms·

Looking to the future - I guess eye tracking somewhat deprecates the mouse, in theory. The mouse is a very clever abstraction, combining human hand/eye coordin

Looking to the future - I guess eye tracking somewhat deprecates the mouse, in theory. The mouse is a very clever abstraction, combining human hand/eye coordination with the brain's near-effortless spatial transformation of the mouse's horizontal plane to the screen's (usually) vertical(-ish) plane, along with matters of proportion and scale. But it's still an extra layer(s) of abstraction, and of limitation, e.g. the more time your hand is on the mouse, the more time your computing experience is limited to the abilities of the mouse.

dcchambers 3y ago
After doing the vision pro demo in the Apple store I am not so sure I buy eye tracking as the future... Assuming that Apple's tech is best in class, it's still nowhere near as accurate as mouse input. Even if it's 99% accurate, we click on stuff a LOT so you will feel that 1% error rate immediately. I would like to see someone experiment with AVP-level eye tracking for cursor control on a Mac/PC, so that I can leave my hands on my keyboard 100% of the time and still have mouse control. I think this could be huge. I also realize that I track the mouse in my peripheral vision all the time when I am using the computer, especially when using tools I am familiar with. It would be a massive downgrade to have to look exactly where I want to for every action.
canucker2016 3y ago
Probably won't work for the blind/legally blind. I wonder what happens when someone who is cross-eyed or has one real eye and one glass eye try to use the VisionPro?
skydhash 3y ago
> The mouse is a very clever abstraction It's more like an extension of the body itself, the same way we use any tools. And there's a set relation between causes and effects, which becomes more instinctual the more we use it. I think eye tracking suffers from that we use our eyes for perception, not action. Constraining it to action, especially with how slow our movement is, will barely improve our interactions, and may impede them.

dcchambers 3y ago

After doing the vision pro demo in the Apple store I am not so sure I buy eye tracking as the future... Assuming that Apple's tech is best in class, it's still nowhere near as accurate as mouse input. Even if it's 99% accurate, we click on stuff a LOT so you will feel that 1% error rate immediately. I would like to see someone experiment with AVP-level eye tracking for cursor control on a Mac/PC, so that I can leave my hands on my keyboard 100% of the time and still have mouse control. I think this could be huge. I also realize that I track the mouse in my peripheral vision all the time when I am using the computer, especially when using tools I am familiar with. It would be a massive downgrade to have to look exactly where I want to for every action.

canucker2016 3y ago

Probably won't work for the blind/legally blind. I wonder what happens when someone who is cross-eyed or has one real eye and one glass eye try to use the VisionPro?

skydhash 3y ago

> The mouse is a very clever abstraction It's more like an extension of the body itself, the same way we use any tools. And there's a set relation between causes and effects, which becomes more instinctual the more we use it. I think eye tracking suffers from that we use our eyes for perception, not action. Constraining it to action, especially with how slow our movement is, will barely improve our interactions, and may impede them.