8 ms·
Real time lightsaber tracking and rendering on the Kinect
- DanielRibeiro 16y agoOn ubuntu. Great to see that hacking kinect is already enabling other hacks.
- tocomment 16y agoSo how did he do that? (High level explanation is fine)
- sp332 16y agoHe says he's using the OpenCV library. I assume it's got the tracking and rendering functionality already in the library, and he just plugged the Kinect video and IR depth data into it. http://en.wikipedia.org/wiki/Opencv http://en.wikipedia.org/wiki/Opencv
- grantjgordon 16y agoHah! I've gotta get me a kinect for tinkering purposes...
- evo_9 16y agoI think I have a different definition for 'real-time'. Pretty cool though for sure.
- mrbad101 16y agoWouldn't it be better if he was only holding a small 6" long stick, the kinect tracks that, and digitally adds the extended lightsaber? Maybe this was just his step 1. It would minimize the destruction caused in your home from swinging around a 4' stick.
- collint 16y agoMaybe you could use the wiimote in combination with the physical tracking to get more precise telemetry + precise physical location and AR.
- kreneskyp 16y agoThat was my thought a week ago. The kinect is limited in that it can only see the front of your body. Some movements obscure your body and it basically just freaks out.
- modeless 16y agoYou just described Playstation Move.
- NickPollard 16y agoThere have already been Playstation Move demos that do exactly this, with superb accuracy and great response times. (Disclaimer: I work for SCEE, but this is my own opinion)
- ent 16y agoThe full length stick works better for duels. Filming cool duels is pretty much what this thing screams to be used for. Of course to minimize damage, you could probably use something lighter than a solid wooden stick.
- pyre 16y agoFull-length duals have already been done, though. I don't think that is the killer application of this tech.
- jhen095 16y agodisappointingly there is still a bit of lag in there. Though I'm sure that can be improved in time. It would be interesting to see him swing the stick around faster, see if the rendering can keep up an still track the stick when it is a blur. Looks like fun!
- est 16y agoI heard that Kinect only lags for a few frames. Perhaps the main lag is the rendering lag?
- farnsworth 16y agoCouldn't you do this with any webcam and CV? I don't see how the depth component makes it any easier.
- sandaru1 16y agoAs far as I understand, depth values make the blob detection easier. Normally blob detection tries to use the brightness differences caused by 3D objects - depth values make it much accurate. http://en.wikipedia.org/wiki/Blob_detection http://en.wikipedia.org/wiki/Blob_detection The youtube video channel of the author has his previous demos : http://www.youtube.com/user/yankeyan http://www.youtube.com/user/yankeyan
- est 16y agoThe main problem (with real time) here is that you can't move the stick too fast or Kinect will lose the tracking.
- joblessjunkie 16y ago...if by "real time" you mean delayed by 200ms.
- kevingadd 16y agoIn graphics terms when someone says 'realtime' they usually are referring to the performance of the algorithm, not whether or not there's a delay. Lots of video games have input delays of 100ms or more. The framerate is pretty bad, though. I wonder why - I was under the impression the Kinect captures at 30fps.
- emarcotte 16y agoIt looks like he had a CPU monitor on his panel, which also looked pegged. Could just be he needs to spend sometime optimizing cause the Kinect can certainly record faster than that.
- nutjob123 16y agoNeat but not really exciting from a technological standpoint. Then again if I was 12 this would be pretty sweet....
- jcfrei 16y agothis is a potential killer application. if they manage to make the tracking fluent and accurate, everybody can finally duell other players in epic lightsaber fights. anyone who liked star wars has probably been waiting for this - let's see who gets it right first - PS3 Move, Kinect or even Wii?
- ben0x539 16y ago> He says the next step would be to add a flying droid that shoots lasers, a blind fold, etc. Great, once they have a blindfold the rendering delay will not even be noticable anymore. Or the rest of the rendering, really.