3 ms·
Does anyone have any idea how this works?
by tomp 14y ago
Does anyone have any idea how this works?
- pavlov 14y agoI have one of the Leap prototype units through the SDK program. (They say there's no NDA and they want people to talk about it, so it should be ok to post my observations here...) My unit doesn't have the final casing, so the basic components are in plain sight. There are two cameras and some infrared LEDs. The LEDs appear to emit a sequence of pulses which is seen by the cameras at a high frame rate -- somewhere in the Leap docs it's mentioned that the highest frame rate sent by the device over USB is around 300 fps. The magic is in the processing, of course. I don't know how that is split between the device and the Leap driver running on the host computer. The data obtained through the SDK is preprocessed into hands that are further divided into fingers or "tools" such as a pencil being held by the user. It doesn't seem to be possible to get raw depth data, but the hand data is high quality and the latency is impressive -- it feels very good in use.
- pfraze 14y agoRE: the infrared LEDs, I believe that's how the kinect works as well.
- pavlov 14y agoThe Kinect is a bit different. It has one regular camera, one infrared camera and an infrared projector. It projects a random-looking pattern which is seen by the camera and analyzed by the unit's firmware. The pattern's perspective and scale distortions are mapped into depth coordinates (perhaps aided by the visible light camera image). The device then outputs RGB+depth images via USB with a maximum frame rate of 60 fps. The Leap doesn't have an infrared projector that could emit a precise pattern, but it has two infrared cameras that run at a much higher rate than the Kinect's. I think the Leap's depth detection is based primarily on stereo vision mapping with some kind of temporal component.
- pfraze 14y agoAh, interesting. Thanks.
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]
- fatjokes 14y agoSounds like a Kinect.
- qwertyboy 14y agoYou can use pretty much any webcam or phone cam to see well into the infra-red. If you turn off the lights and look at the device - and especially at your hand using it - through such a camera, you are likely to see the IR and gain some extra insight as to how it works.
- aufreak3 14y agoFrom your description, it looks like it can be repurposed as a 3d scanner (as imagined by monk_e_boy). Would be nice to see raw access. I would like to use it to scan fingering techniques on string instruments.