5 ms·

All that is mentioned here so far as I can see is a method for getting focus information coupled with a virtual retinal display. How are they proposing to get t

All that is mentioned here so far as I can see is a method for getting focus information coupled with a virtual retinal display. How are they proposing to get the image on the other side of the arbitrary thing you are supposed to be able to look through?

jonmrodriguez 15y ago
EDIT: I think that in the future, the following phenomena are likely to proliferate: - high-res satellite and airplane imaging of the globe - public geotagged photos, including compass bearing - Google Street View road images - public security cameras on public streets All of this data can be integrated using software like Microsoft's PhotoSynth, to stitch together a gigantic 3D model of the real globe. Then, people with Voxel Vision will be able to look around at streets and landmarks that are interesting but physically occluded. ====== Edited to rise a relevant comment from further down the thread. Original answer follows: Jon Rodriguez here, project lead. Your question seems ambiguously worded. I will answer both possible interpretations of the question: === Q: "How do you propose to do the sensing task of seeing inside real world objects so that that data can be rendered?" A: The source of content depends on the application. 1: put a virtual screen at distance infinity, so in a boring meeting you just look far away to check your email 2: for telepresence surgery, use a MRI to do the 3D imaging of the patient's interior 3: Google Street View images allow you to see to any point in a city, even if buildings are between you and it 4: educators create custom 3D models of physical phenomena they want the kids to vividly explore, such as a 3D model of a human neuron, or a 3D geological model of the Earth, or the interior of a grape. Etc. In particular, virtual reality games and worlds can be easily shown this way, as long as the game artists take the extra effort to give their models interesting interiors. === Q: "How does a Heads Up Display that is in front of a real-world object (like a brick wall) then project a virtual image that appears to be behind that object?" A: This is where the adjustable lens on the virtual retinal display comes in. By properly decollimating the light from the VRD's screen or laser, you can give that light an arbitrary "equivalent optical distance". Despite the fact that the light is originating at 2 cm from the eye, it can appear to originate at 2 km from the eye, in that 2 km is that distance that the eye will have to accommodate to to put that light in focus.
- wlievens 15y ago
  > Despite the fact that the light is originating at 2 cm from the eye, it can appear to originate at 2 km from the eye, in that 2 km is that distance that the eye will have to accommodate to to put that light in focus. But there's a wall in front of it. How can I perceive an object as 10m away when I'm staring at a wall at 2m away?
  - jonmrodriguez 15y ago
    The wall will appear as if it: - were translucent, and - had a screen behind it The light arrives at your eye containing both an image of a wall when focusing at 3m and an image of a TV show when focusing at 20m. Such a light field is not distinguishable from the light field that would occur if the wall actually were translucent and actually did have a TV show playing on a screen behind it
    - milkshakes 15y ago
      i think his question has less to do with how your system will render the information about what's behind the wall, and more to do with how your system will acquire that information in the first place
      - jonmrodriguez 15y ago
        I think that in the future, the following phenomena are likely to proliferate: - high-res satellite and airplane imaging of the globe - public geotagged photos, including compass bearing - Google Street View road images - public security cameras on public streets All of this data can be integrated using software like Microsoft's PhotoSynth, to stitch together a gigantic 3D model of the real globe. Then, people with Voxel Vision will be able to look around at streets and landmarks that are interesting but physically occluded.
        blackiron 15y ago
        3d data of the surroundings could be also obtained with a portable sound-to-3d sonar system.. not sure if such exists yet but it would be a cool thing to connect to your device for enhanced bat-sight.

jonmrodriguez 15y ago

EDIT: I think that in the future, the following phenomena are likely to proliferate: - high-res satellite and airplane imaging of the globe - public geotagged photos, including compass bearing - Google Street View road images - public security cameras on public streets All of this data can be integrated using software like Microsoft's PhotoSynth, to stitch together a gigantic 3D model of the real globe. Then, people with Voxel Vision will be able to look around at streets and landmarks that are interesting but physically occluded. ====== Edited to rise a relevant comment from further down the thread. Original answer follows: Jon Rodriguez here, project lead. Your question seems ambiguously worded. I will answer both possible interpretations of the question: === Q: "How do you propose to do the sensing task of seeing inside real world objects so that that data can be rendered?" A: The source of content depends on the application. 1: put a virtual screen at distance infinity, so in a boring meeting you just look far away to check your email 2: for telepresence surgery, use a MRI to do the 3D imaging of the patient's interior 3: Google Street View images allow you to see to any point in a city, even if buildings are between you and it 4: educators create custom 3D models of physical phenomena they want the kids to vividly explore, such as a 3D model of a human neuron, or a 3D geological model of the Earth, or the interior of a grape. Etc. In particular, virtual reality games and worlds can be easily shown this way, as long as the game artists take the extra effort to give their models interesting interiors. === Q: "How does a Heads Up Display that is in front of a real-world object (like a brick wall) then project a virtual image that appears to be behind that object?" A: This is where the adjustable lens on the virtual retinal display comes in. By properly decollimating the light from the VRD's screen or laser, you can give that light an arbitrary "equivalent optical distance". Despite the fact that the light is originating at 2 cm from the eye, it can appear to originate at 2 km from the eye, in that 2 km is that distance that the eye will have to accommodate to to put that light in focus.

wlievens 15y ago
> Despite the fact that the light is originating at 2 cm from the eye, it can appear to originate at 2 km from the eye, in that 2 km is that distance that the eye will have to accommodate to to put that light in focus. But there's a wall in front of it. How can I perceive an object as 10m away when I'm staring at a wall at 2m away?
- jonmrodriguez 15y ago
  The wall will appear as if it: - were translucent, and - had a screen behind it The light arrives at your eye containing both an image of a wall when focusing at 3m and an image of a TV show when focusing at 20m. Such a light field is not distinguishable from the light field that would occur if the wall actually were translucent and actually did have a TV show playing on a screen behind it
  - milkshakes 15y ago
    i think his question has less to do with how your system will render the information about what's behind the wall, and more to do with how your system will acquire that information in the first place
    - jonmrodriguez 15y ago
      I think that in the future, the following phenomena are likely to proliferate: - high-res satellite and airplane imaging of the globe - public geotagged photos, including compass bearing - Google Street View road images - public security cameras on public streets All of this data can be integrated using software like Microsoft's PhotoSynth, to stitch together a gigantic 3D model of the real globe. Then, people with Voxel Vision will be able to look around at streets and landmarks that are interesting but physically occluded.
      - blackiron 15y ago
        3d data of the surroundings could be also obtained with a portable sound-to-3d sonar system.. not sure if such exists yet but it would be a cool thing to connect to your device for enhanced bat-sight.