15 ms·

How is this an improvement over using a kinect to sense full body motion?

supermatt 13y ago
Kinect: is basically an optical sensor so it requires line of sight. It utilizes computer vision and a 3d depth map (generated by using an IR projector and receiver) to make an educated guess as to your bodies orientation. Line of sight (needs to see you), Field of View (need to be within range), Body orientation (need to look humanoid, i.e. upright with 2 arms and legs), movement speed (not faster than the optical sensor or IR projector), clothing (not too baggy), lighting (low IR), etc, can all effect the (limited) accuracy of the kinect. PrioVR: A system like this provides accurate positioning of all necessary joints in your body to form a true 3d representation of your skeletal orientation without any of the optical limitations or guesswork of the kinect. You could also use it outside, walking down the street, with a laptop in a backpack. i.e. it could be used for augmented reality in any situation. In the future, I would expect a HMD (some kind of visor - an oculus with a camera in the short-term maybe), a full body suit (like this), and some gloves (the next project these guys will be working on) to be how we augment reality. I don't think we can let this opportunity slide, which is why i'm being so vocal about it!
- minutetominute 13y ago
  The new Kinect for the XboxOne seems to have vastly improved on the limitations of the Xbox360 Kinect. The PrioVR seems to be too ahead of its time. We don't have the battery tech to power all the tech you would be carrying on your body to play any immersive games for an extended period of time. Therefore, you would more than likely be tethered to a power source. If you need to stay in one location, might as well use a Kinect where you can be entirely free of wires. Powering just a visor would seem more feasible than a whole gaming rig. In addition, the current get-up seems cumbersome. I don't imagine that most consumers want to spend time strapping a multitude of sensors to their body just to play a quick game. The sensors themselves are great, but until we can shrink them down enough to embed them in actual clothing, I don't think we'll see them in commonplace usage.
  - STRML 13y ago
    Has anyone done a Kinect + Oculus demo yet? Perhaps the last gen Kinect wasn't high enough resolution to get it right, but the next gen may be enough to do a somewhat convincing in-body effect.
    - supermatt 13y ago
      Yes, there are a number of us in the oculus forums working on various solutions with (the current) kinect for positional data. For me, oculus aside, facial capture is probably the most exciting thing the new kinect can offer (due to increased depth and optical resolution), but it still has all the same limitations as the last one for full body capture (as its basically the same mechanism). There are a number of full body mocap solutions built by third parties that utilize the data from multiple kinects. This certainly helps, but it still can't be as accurate as something like this, solely due to you being a coloured point cloud blob instead of collection of bones in the softwares eyes.
      - thenomad 13y ago
        Hmm, very interesting. Can you give me any links for the facial capture stuff? My full-body mocap needs are mostly sorted, but I'm extremely interested in facial mocap solutions right now because all the existing ones either exceed my budget or suck.
        supermatt 13y ago
        Faceshift.com is what I have played with most. It's amazingly accurate with even the current kinect, but starts at $800 for the indie version. Brekel.com have a less expensive version, but I have no experience with it. Open source alternatives seem thin on the ground, if not non existent. Try faceshift, there's a free trial. It's mind blowingly awesome.
        thenomad 13y ago
        $800 for a facial mocap solution sounds, frankly, brilliant. I shall check it out on Monday/Tuesday. How does the setup work? I'm assuming you have to spend a while tying expressions to morph targets on the model?

Kinect: is basically an optical sensor so it requires line of sight. It utilizes computer vision and a 3d depth map (generated by using an IR projector and receiver) to make an educated guess as to your bodies orientation. Line of sight (needs to see you), Field of View (need to be within range), Body orientation (need to look humanoid, i.e. upright with 2 arms and legs), movement speed (not faster than the optical sensor or IR projector), clothing (not too baggy), lighting (low IR), etc, can all effect the (limited) accuracy of the kinect. PrioVR: A system like this provides accurate positioning of all necessary joints in your body to form a true 3d representation of your skeletal orientation without any of the optical limitations or guesswork of the kinect. You could also use it outside, walking down the street, with a laptop in a backpack. i.e. it could be used for augmented reality in any situation. In the future, I would expect a HMD (some kind of visor - an oculus with a camera in the short-term maybe), a full body suit (like this), and some gloves (the next project these guys will be working on) to be how we augment reality. I don't think we can let this opportunity slide, which is why i'm being so vocal about it!

minutetominute 13y ago
The new Kinect for the XboxOne seems to have vastly improved on the limitations of the Xbox360 Kinect. The PrioVR seems to be too ahead of its time. We don't have the battery tech to power all the tech you would be carrying on your body to play any immersive games for an extended period of time. Therefore, you would more than likely be tethered to a power source. If you need to stay in one location, might as well use a Kinect where you can be entirely free of wires. Powering just a visor would seem more feasible than a whole gaming rig. In addition, the current get-up seems cumbersome. I don't imagine that most consumers want to spend time strapping a multitude of sensors to their body just to play a quick game. The sensors themselves are great, but until we can shrink them down enough to embed them in actual clothing, I don't think we'll see them in commonplace usage.
- STRML 13y ago
  Has anyone done a Kinect + Oculus demo yet? Perhaps the last gen Kinect wasn't high enough resolution to get it right, but the next gen may be enough to do a somewhat convincing in-body effect.
  - supermatt 13y ago
    Yes, there are a number of us in the oculus forums working on various solutions with (the current) kinect for positional data. For me, oculus aside, facial capture is probably the most exciting thing the new kinect can offer (due to increased depth and optical resolution), but it still has all the same limitations as the last one for full body capture (as its basically the same mechanism). There are a number of full body mocap solutions built by third parties that utilize the data from multiple kinects. This certainly helps, but it still can't be as accurate as something like this, solely due to you being a coloured point cloud blob instead of collection of bones in the softwares eyes.
    - thenomad 13y ago
      Hmm, very interesting. Can you give me any links for the facial capture stuff? My full-body mocap needs are mostly sorted, but I'm extremely interested in facial mocap solutions right now because all the existing ones either exceed my budget or suck.
      - supermatt 13y ago
        Faceshift.com is what I have played with most. It's amazingly accurate with even the current kinect, but starts at $800 for the indie version. Brekel.com have a less expensive version, but I have no experience with it. Open source alternatives seem thin on the ground, if not non existent. Try faceshift, there's a free trial. It's mind blowingly awesome.
        thenomad 13y ago
        $800 for a facial mocap solution sounds, frankly, brilliant. I shall check it out on Monday/Tuesday. How does the setup work? I'm assuming you have to spend a while tying expressions to morph targets on the model?