4 ms·
How well does it do with occlusion? Holding, or manipulating an object, and capturing those interactions.
by klaussilveira 4y ago
How well does it do with occlusion? Holding, or manipulating an object, and capturing those interactions.
- karim79 4y agoWas wondering the same thing - if it does well there, it could be a really cheap way to, for example, motion-capture realistic weapon holding in an FPS, provided it can be extended to capture the arms as well using CV.
- klaussilveira 4y agoIt would need some cleanup, but definitely usable.
- diegomacario 4y agoIt does amazingly well. Last May Meta released their Hand Tracking 2.0 update, and the quality of the hand tracking improved enormously. You can see a comparison of 1.0 and 2.0 here: https://www.youtube.com/watch?v=K-l-RXxYnzs&t=4s&ab_channel=UploadVR https://www.youtube.com/watch?v=K-l-RXxYnzs&t=4s&ab_channel=...
- klaussilveira 4y agoWhat about arms? Or would it have to rely on some realtime IK solution to sort them out?
- diegomacario 4y agoFor the arms you could use Meta's new Movement SDK: https://developer.oculus.com/documentation/unity/move-overview/ https://developer.oculus.com/documentation/unity/move-overvi... Although in my opinion the arms still look a bit janky. You can see a demo of a sample they included with the SDK here: https://youtu.be/IQt4wTdGK64?t=419 https://youtu.be/IQt4wTdGK64?t=419