5 ms·
The main differences with indoors vs outdoors are illumination and distances. In terms of motion tracking, outdoors tends to be a lot easier because there are f
by joshvm 8y ago
The main differences with indoors vs outdoors are illumination and distances. In terms of motion tracking, outdoors tends to be a lot easier because there are far more varied/unique textures than indoors.
Outdoor environments get a huge amount of NIR light which can swamp cameras without an IR cut filter. It's possible that the Leap is using infrared imagery for motion/depth tracking. Similarly devices which project structured light for 3D reconstruction usually use NIR projection. These devices fail in sunlight.
The other issue is depth. Depth sensing on a device like the Leap is going to be done using either time of flight, structured light or stereo [1]. Time of flight is unlikely due to the amount of power you need to dissipate on the LEDs (see the Kinect V2) - which are mounted next to your face. This approach would also preclude outdoor use, see above. If they're using stereo alone, then the depth accuracy will only be good at close range. For a typical baseline of say 20 cm, you're going to get reasonable results up to 5 metres [2]. More robustness if you use structured light to assist.
[1] There appear to be multiple cameras, so why would you not exploit the geometry?
[2] Back of the envelope calculation: stereo error at 10m using a 20cm baseline, 2.2um pixels, 5mm focal length and 0.5px accuracy is about 5cm. Accuracy at 5m is about 3cm.
- AstralStorm 8y agoYou could get a bit better than stereoscopy by using say 4 cameras. Plus since it is on moving head, you could use a bit of surface from motion techniques. You could also make the cameras rotate on their own (or mirror - like DLP; or lens), like eyes do, to enhance the result when head does not move. Loads of processing power required... solvable. Now the real problem is the display of sufficient brightness and colours. Some sort of future translucent LED screen could do it, maybe. DLP can do it at big cost and with bulky projectors. Current picoprojectors are not very bright... And then three is a focal length problem to solve to have sharp image and good depth range while not messing with accommodation.