5 ms·
XNect: Real-Time Multi-Person 3D Motion Capture with a Single RGB Camera
- mrtweetyhack 6y agoGame changer right here
- IOT_Apprentice 6y agoThis is a great way that various disciplines in sports, dance, martial arts etc. could be captured and preserved. A great first step. Adding in support for additional programming languages like say python could open this up to a wider audience of DIY mocap.
- rednab 6y agoUnfortunately, it appears this technology is made available only for research purposes¹)/people with an institutional email address. Which means that the best way for DYI mocap that I know of is still getting hold of an increasingly rare Kinect One. ¹) https://gvv-assets.mpi-inf.mpg.de/xnect/?page_id=12 https://gvv-assets.mpi-inf.mpg.de/xnect/?page_id=12
- DoingIsLearning 6y agoIs there a reasoning to limit the distribution to other researchers only? It feels even more out-of-place considering most of the authors are affiliated with public institutes and likely benefited from public funding. I actually thought this would be super neat for a poorman version of MS Kinect and hobbie gaming.
- CyberDildonics 6y agoI'm always extremely skeptical of claims like this. For something with input this simple, it could be embedded into a web page and take arbitrary video to prove that it works as well as they claim.
- dynamite-ready 6y agoI was thinking this. Perhaps the researchers have a buyer lined up, but were obliged to publish. So this way, they can at least have a place to start, if the tech leaks into the public domain, or finds it's way into some product.
- maxst 6y agoSo many algorithms insist on using "single RGB camera" approach, when it would be much more practical to use 2 cameras.
- kristopolous 6y agoThe power is the existing giant corpus of video. When I'm in front of a computer I'm going to run this up against the dancing of James Brown and Michael Jackson. Should be interesting. Maybe an Olympic gymnast as well.
- dTal 6y agoPractical for an algorithm implementer, maybe - deeply impractical for real-world use. Stereo cameras are rare and nontrivial (you have to synchronize shutters). Monocular algorithms can be applied to the millions of hours of existing footage, or used with the billions of cameras, smartphones, robots, drones, and fancy doorbells that already exist right now.
- RavlaAlvar 6y agoFor “slow” moving object like human body, does synchronised shutter matters that much and if so , is there any tricks to compensate it if synchronisation is not possible?
- joshvm 6y agoYou can do reasonable software sync with identical cameras and threading - it gets you to within a few milliseconds. Even for slow objects it's a problem because being a few pixels off might make the difference between matching and not.
- maxst 6y agoThere are dozens of 360 cameras on the market, so I think shutters synchronization is not that difficult to implement.
- 6y ago
- Mashimo 6y agoDoes the video have interlacing problems? How does that happen?
- chmod775 6y agoHow long until technology such as this is used for automatic "crime" detection with surveillance cameras? Not looking forward to having that in the west too. This stuff is the wet dream of every authoritarian looking to effectively control a populace. We really ought to amend our constitutions, adding protections against this, while we still can.