2 ms·
This isn't what Quest does. Photogrammetry isn't that good (nor that fast). They just warp the images from the down/outward-facing cameras.
by zaptrem 3y ago
This isn't what Quest does. Photogrammetry isn't that good (nor that fast). They just warp the images from the down/outward-facing cameras.
- dTal 3y agoWell sort of. It's a depth-accurate warp, fed from the SLAM system. This is functionally equivalent to texturing a depth map with the cameras. It has to be this way because there's no other way to simulate having a camera in a different spot than it really is. If they were simple 2d warps, parallax, occlusion, and stereopsis would be all wrong, and you'd feel violently ill any time you moved your head. You can see the system break down if you bring your hand too close to the headset. You're certainly not getting raw passthrough images. I'm not intimately familiar with the precise technical details of the Quest system, but I do know that real time photogrammetry even more sophisticated than depth maps can be achieved on mobile chipsets - google LSD-SLAM.
- zaptrem 3y agoThis makes a lot more sense, thanks for elaborating.