4 ms·

When knowledge workers head to the office, it won't be by driving to a building. It'll be by putting on a VR headset and working in a virtual world that is supe

by natrius 11y ago

When knowledge workers head to the office, it won't be by driving to a building. It'll be by putting on a VR headset and working in a virtual world that is superior to the physical office in many ways. You can work with anyone in the world. There are infinite meeting rooms that can be accessed effortlessly. Everyone gets a private office when they want it. Communicating with loved ones changes too. Why catch up on the phone when you can sit in a living room with them? Virtual reality is not a niche pursuit.

obastani 11y ago
I've tried thinking about how virtual meetings would work, but to me it seems to be flawed. Virtual reality allows us to view a 3D environment as if we are there, but how would we capture that 3D environment to begin with? Is there technology that allows us to capture not just 3D, but 3D from all angles? I expect that for "presence" to work, when you move your head, the perspective that the camera sees (on the other end) would need to change, and I can't imagine how this would be achieved.
- dshankar 11y ago
  Many technologies exist to achieve this, they're just not in the "consumer ready" stage yet. 3D scanning is best for static objects like walls in your room. They never move or change, so scan the whole space. When you turn your head in VR, you'll see accurate 3D representations of that 3D environment. Full 6DOF tracking is another method. Given a 3D scanned static object, like a coffee cup, you can track it using various optical and IMU-based techniques. This means a static object can be dynamically tracked as it moves, giving you accurate information about the 3D world to pick up your coffee cup without spilling it. Optical tracking can be used to replicate facial movements into 3D models (see: Faceshift), to track finger movements (see: LeapMotion/Kinect), or full body motion. Video can fill in the gaps for dynamic content. This can be achieved in two ways: 1) depth cameras which combine RGB video like a normal camera with depth information, allow us to reconstruct dynamic objects at proper depth. 2) 360-degree stereoscopic video which gives a fixed perspective to the full 3D environment. This isn't great for "3D from all angles" as non-rotational head movements won't see an accurate view. A combination of these technologies will enable a VR user to see a real 3D environment, and feel like they are in it. One thing is certain: it's coming. It's just a matter of time. The technology is rapidly maturing.
- UberMouse 11y ago
  Here is some very interesting tech from OTOY that is basically doing that, http://uploadvr.com/diy-wormholes-hands-on-with-otoys-light-field-scanner/ http://uploadvr.com/diy-wormholes-hands-on-with-otoys-light-... "Recap: the rig takes two Canon DSLRs and spins them around in a circle, capturing a dense light field image. The resulting data, when properly processed, can be rendered with OTOY’s pipeline and delivered to a VR headset with full head tracking. It’s a static scene but OTOY have alluded to future video capture."
untog 11y ago
There are a lot of unanswered questions in there, though. If I'm sat in a living room with my loved ones, what am I looking at? A live 3D video of them? What is capturing that video? Will I see them wearing a headset? Because that's going to look pretty bad. Something I think people often forget about VR - it's going to be really weird to be totally disconnected from the environment around you. If you're plugged into a meeting and your kid runs into the room to get your attention, how will they do it? Probably by poking you, scaring the bejesus out of you. I just don't buy the idea that VR will make our lives more "real". It'll lead to living in weird bubbles.
- AJ007 11y ago
  It isn't difficult to connect the external world to an otherwise external sensory deprived VR environment, either with external cameras or smart overlays. I suspect Facebook may try something similar to how Steam functions within games.
- dshankar 11y ago
  That's because you treat VR vs AR vs reality as three different extremes. They're not. Think of them as a spectrum. VR + stereoscopic image passthrough gets you an AR-like view of the real world around you. These overlays allow you to pick up coffee cups, see when your kid is poking you, etc.
- vectorjohn 11y ago
  Isn't the solution obvious? https://upload.wikimedia.org/wikipedia/commons/0/09/Googly.jpg https://upload.wikimedia.org/wikipedia/commons/0/09/Googly.j...
- lux 11y ago
  Here are some of my thoughts on your questions: https://news.ycombinator.com/item?id=9938332 https://news.ycombinator.com/item?id=9938332 Valve is solving walking into walls by showing you a holodeck-like barrier inside the headset, so something like that could work with moving objects like kids or the dog over time too. Still, you are quite disconnected from the world that's actually around you. In terms of making technology more human, I see VR as a stepping stone to Augmented Reality, which will eventually allow us to interact with our hands and instead of being in another world, you'll see things brought into your own world. That is an improvement over a screen too. But VR can also transport you to places you've never been through 360 video, which is a powerful opportunity to create empathy through journalism and documentaries that can help us better understand how people live halfway across the world. I'm rather excited for that. While any technology has the potential to further divide or distract us, VR has made me feel things that no other technology has even come close to feeling.
dshankar 11y ago
I'm working on this!
azinman2 11y ago
What's the advantage over FaceTime? I only see disadvantages... I have to wear this giant thing that prevents me from seeing my arms and anything else physically around me, no ability to capture my actual head and eyes unless you do a bunch of fancy 3d reconstruction, etc.
- lux 11y ago
  Think longer term, when augmented reality advances sufficiently that it will look like the person is sitting right across from you. No loss of non-verbal communication, which is still pretty limited to a small field of view over FaceTime. VR won't solve this in an elegant way immediately, although virtual avatars will soon have eye and facial expression tracking, so at least the avatar will mimic your actual expressions inside of a virtual space. The value add there is that you can be in a shared collaborative space with additional objects besides just other people, and interact with those together.
chadgeidel 11y ago
I think there are other hurdles to remote work. Management simply doesn't want it to happen. I'm in a small, very technology-savvy company and - even though we are currently out of office space - there is no option to work from home even part time. The traditional reasons of "need collaboration" / "we work face to face" are always given.
- Retra 11y ago
  There's a lot of value and comfort that people get from the kind of spontaneity involved in face-to-face communication. If you have to plan a virtual meeting, you loose that. As well as the benefits of walking around to meet with people.
  - chadgeidel 11y ago
    I agree wholehartedly! There is a lot of value. Is there so much value such that an employer cannot allow any remote work?

by natrius 11y ago

obastani 11y ago

I've tried thinking about how virtual meetings would work, but to me it seems to be flawed. Virtual reality allows us to view a 3D environment as if we are there, but how would we capture that 3D environment to begin with? Is there technology that allows us to capture not just 3D, but 3D from all angles? I expect that for "presence" to work, when you move your head, the perspective that the camera sees (on the other end) would need to change, and I can't imagine how this would be achieved.

dshankar 11y ago
Many technologies exist to achieve this, they're just not in the "consumer ready" stage yet. 3D scanning is best for static objects like walls in your room. They never move or change, so scan the whole space. When you turn your head in VR, you'll see accurate 3D representations of that 3D environment. Full 6DOF tracking is another method. Given a 3D scanned static object, like a coffee cup, you can track it using various optical and IMU-based techniques. This means a static object can be dynamically tracked as it moves, giving you accurate information about the 3D world to pick up your coffee cup without spilling it. Optical tracking can be used to replicate facial movements into 3D models (see: Faceshift), to track finger movements (see: LeapMotion/Kinect), or full body motion. Video can fill in the gaps for dynamic content. This can be achieved in two ways: 1) depth cameras which combine RGB video like a normal camera with depth information, allow us to reconstruct dynamic objects at proper depth. 2) 360-degree stereoscopic video which gives a fixed perspective to the full 3D environment. This isn't great for "3D from all angles" as non-rotational head movements won't see an accurate view. A combination of these technologies will enable a VR user to see a real 3D environment, and feel like they are in it. One thing is certain: it's coming. It's just a matter of time. The technology is rapidly maturing.
UberMouse 11y ago
Here is some very interesting tech from OTOY that is basically doing that, http://uploadvr.com/diy-wormholes-hands-on-with-otoys-light-field-scanner/ http://uploadvr.com/diy-wormholes-hands-on-with-otoys-light-... "Recap: the rig takes two Canon DSLRs and spins them around in a circle, capturing a dense light field image. The resulting data, when properly processed, can be rendered with OTOY’s pipeline and delivered to a VR headset with full head tracking. It’s a static scene but OTOY have alluded to future video capture."

untog 11y ago

There are a lot of unanswered questions in there, though. If I'm sat in a living room with my loved ones, what am I looking at? A live 3D video of them? What is capturing that video? Will I see them wearing a headset? Because that's going to look pretty bad. Something I think people often forget about VR - it's going to be really weird to be totally disconnected from the environment around you. If you're plugged into a meeting and your kid runs into the room to get your attention, how will they do it? Probably by poking you, scaring the bejesus out of you. I just don't buy the idea that VR will make our lives more "real". It'll lead to living in weird bubbles.

AJ007 11y ago
It isn't difficult to connect the external world to an otherwise external sensory deprived VR environment, either with external cameras or smart overlays. I suspect Facebook may try something similar to how Steam functions within games.
dshankar 11y ago
That's because you treat VR vs AR vs reality as three different extremes. They're not. Think of them as a spectrum. VR + stereoscopic image passthrough gets you an AR-like view of the real world around you. These overlays allow you to pick up coffee cups, see when your kid is poking you, etc.
vectorjohn 11y ago
Isn't the solution obvious? https://upload.wikimedia.org/wikipedia/commons/0/09/Googly.jpg https://upload.wikimedia.org/wikipedia/commons/0/09/Googly.j...
lux 11y ago
Here are some of my thoughts on your questions: https://news.ycombinator.com/item?id=9938332 https://news.ycombinator.com/item?id=9938332 Valve is solving walking into walls by showing you a holodeck-like barrier inside the headset, so something like that could work with moving objects like kids or the dog over time too. Still, you are quite disconnected from the world that's actually around you. In terms of making technology more human, I see VR as a stepping stone to Augmented Reality, which will eventually allow us to interact with our hands and instead of being in another world, you'll see things brought into your own world. That is an improvement over a screen too. But VR can also transport you to places you've never been through 360 video, which is a powerful opportunity to create empathy through journalism and documentaries that can help us better understand how people live halfway across the world. I'm rather excited for that. While any technology has the potential to further divide or distract us, VR has made me feel things that no other technology has even come close to feeling.

dshankar 11y ago

I'm working on this!

azinman2 11y ago

What's the advantage over FaceTime? I only see disadvantages... I have to wear this giant thing that prevents me from seeing my arms and anything else physically around me, no ability to capture my actual head and eyes unless you do a bunch of fancy 3d reconstruction, etc.

lux 11y ago
Think longer term, when augmented reality advances sufficiently that it will look like the person is sitting right across from you. No loss of non-verbal communication, which is still pretty limited to a small field of view over FaceTime. VR won't solve this in an elegant way immediately, although virtual avatars will soon have eye and facial expression tracking, so at least the avatar will mimic your actual expressions inside of a virtual space. The value add there is that you can be in a shared collaborative space with additional objects besides just other people, and interact with those together.

chadgeidel 11y ago

I think there are other hurdles to remote work. Management simply doesn't want it to happen. I'm in a small, very technology-savvy company and - even though we are currently out of office space - there is no option to work from home even part time. The traditional reasons of "need collaboration" / "we work face to face" are always given.

Retra 11y ago
There's a lot of value and comfort that people get from the kind of spontaneity involved in face-to-face communication. If you have to plan a virtual meeting, you loose that. As well as the benefits of walking around to meet with people.
- chadgeidel 11y ago
  I agree wholehartedly! There is a lot of value. Is there so much value such that an employer cannot allow any remote work?