3 ms·

This will definitely never happen with “monitor”-style technology, because AR/VR with face tracking will do it. That’s probably five years out. As a side note,

This will definitely never happen with “monitor”-style technology, because AR/VR with face tracking will do it. That’s probably five years out. As a side note, I believe eye contact and 3D projected body language tracking are the limiting technology for virtual offices to leapfrog physical offices. It’s my expectation that when those two technologies are cheap ($600 all-in-one device) it will massively disrupt both commercial real estate and any residential markets that are commute dominated. I believe particularly in the Bay Area this will be the source of the next housing market collapse. Particularly since Facebook is heavily invested in telepresence now, and has a clear path to a device like I described within ~5 years. Google and Apple, in all likelihood, will put out a similar device in that timeframe as well.

aantix 7y ago
Do you have any links where we explore such prototypes?
- erikpukinskis 7y ago
  You can look up some of the foveated rendering prototypes. The non-static ones have eye tracking. I have seen a few headsets with downward facing cameras but not many. There are hard problems around both technologies so they are mostly research prototypes at this point I think, not consumer alphas.
  - erikpukinskis 7y ago
    Also I think some Leap Motion prototypes might be facing downward and tracking body. I seem to remember one that had the Leap sensor on little arms sticking out on little arms. As I said I believe Facebook, Google, and Apple all have this tech on the far side of their roadmaps. So I don’t see all three failing. But even if they do, the Leap Motion roadmap points there, and... while Leap is obviously mismanaged, new parent company is UltraHaptics. Hopefully they can get Leap into a headset.... Regardless, the Leap founder (Ed: David Holz) knows exactly what’s necessary for telepresence in VR, and I don’t think any amount of mismanagement will stop him from executing it EVENTUALLY. But he’ll take 10 years, and Facebook might do it in 3. Apple could roll it out next year for all we know. They’ve prototyped all the tech already in ARKit. David if you’re in this thread and you want to build a leap headset email me. We can just disassemble Oculus Go’s and add a Leap and... well you wrote the 6DOF code already right? Solder a coprocessor on the board that can do it without any battery drain. Maybe we have to design one, IDK. Sacrifice a kitten. Hire a stats PhD and make it “stochastic”. Put a neural net processor between the cameras and the computer. Who knows. Then ship it with a Nintendo 64 emulator ONLY, that’s the entire OS, no games you have to sideload them. And mark it up to $999. Fund the company on preorders.
    - erikpukinskis 7y ago
      Strip off the Go’s plastic and CNC a custom enclosure, faceplate carved to the buyer’s design. Use a portion of every sale to fund artists creating faceplate designs for customers to choose from. Needs IPD adjust, off ear audio
  - jcims 7y ago
    I work from home already. No way im getting a ‘downward facing camera’. I’ll have to get the Genie Lamp plugin and just float around the virtual office sicut spiritus.
    - erikpukinskis 7y ago
      Seems reasonable that you could choose to be disembodied. You would still benefit from having a point location in the meeting room. That’s one of the basic improvements VR gives you over videoconferencing. Maybe two floating eyes (for gaze direction and eye contact) plus some canned emoji-style gestures? My point is you, as a person for whom current gen VR is enough—no eye or body tracking needed—are atypical. Most workers need body language and eye contact to communicate effectively.
bboreham 7y ago
Microsoft have also been researching this area for >15 years. https://www.microsoft.com/en-us/research/project/eye-gaze-correction-for-video-telecommunications/ https://www.microsoft.com/en-us/research/project/eye-gaze-co...

aantix 7y ago

Do you have any links where we explore such prototypes?

erikpukinskis 7y ago
You can look up some of the foveated rendering prototypes. The non-static ones have eye tracking. I have seen a few headsets with downward facing cameras but not many. There are hard problems around both technologies so they are mostly research prototypes at this point I think, not consumer alphas.
- erikpukinskis 7y ago
  Also I think some Leap Motion prototypes might be facing downward and tracking body. I seem to remember one that had the Leap sensor on little arms sticking out on little arms. As I said I believe Facebook, Google, and Apple all have this tech on the far side of their roadmaps. So I don’t see all three failing. But even if they do, the Leap Motion roadmap points there, and... while Leap is obviously mismanaged, new parent company is UltraHaptics. Hopefully they can get Leap into a headset.... Regardless, the Leap founder (Ed: David Holz) knows exactly what’s necessary for telepresence in VR, and I don’t think any amount of mismanagement will stop him from executing it EVENTUALLY. But he’ll take 10 years, and Facebook might do it in 3. Apple could roll it out next year for all we know. They’ve prototyped all the tech already in ARKit. David if you’re in this thread and you want to build a leap headset email me. We can just disassemble Oculus Go’s and add a Leap and... well you wrote the 6DOF code already right? Solder a coprocessor on the board that can do it without any battery drain. Maybe we have to design one, IDK. Sacrifice a kitten. Hire a stats PhD and make it “stochastic”. Put a neural net processor between the cameras and the computer. Who knows. Then ship it with a Nintendo 64 emulator ONLY, that’s the entire OS, no games you have to sideload them. And mark it up to $999. Fund the company on preorders.
  - erikpukinskis 7y ago
    Strip off the Go’s plastic and CNC a custom enclosure, faceplate carved to the buyer’s design. Use a portion of every sale to fund artists creating faceplate designs for customers to choose from. Needs IPD adjust, off ear audio
- jcims 7y ago
  I work from home already. No way im getting a ‘downward facing camera’. I’ll have to get the Genie Lamp plugin and just float around the virtual office sicut spiritus.
  - erikpukinskis 7y ago
    Seems reasonable that you could choose to be disembodied. You would still benefit from having a point location in the meeting room. That’s one of the basic improvements VR gives you over videoconferencing. Maybe two floating eyes (for gaze direction and eye contact) plus some canned emoji-style gestures? My point is you, as a person for whom current gen VR is enough—no eye or body tracking needed—are atypical. Most workers need body language and eye contact to communicate effectively.

bboreham 7y ago

Microsoft have also been researching this area for >15 years. https://www.microsoft.com/en-us/research/project/eye-gaze-correction-for-video-telecommunications/ https://www.microsoft.com/en-us/research/project/eye-gaze-co...