7 ms·
Kinect reverse-engineered; open driver available
- olalonde 16y agoThat was quick.
- pchristensen 16y agoI'm actually surprised it took this long - how much more motivation did the REs need than MSFT's lawsuit threats?
- qeorge 16y agoHe did it within 3 hours of it going on sale in Europe. That's pretty quick!
- sliverstorm 16y agoI think the internet is getting people to the point they expect it to be hacked a month before the product is actually released ;)
- pchristensen 16y agoI should have read TFA. I was going off of time between headlines.
- deleted 16y ago[deleted]
- sliverstorm 16y agodepressingly quick. Where was the suspense?
- st3fan 16y agoSo much for "With Kinect, Microsoft built in numerous hardware and software safeguards designed to reduce the chances of product tampering" ... :-)
- Pyrodogg 16y agoMicrosoft had already started backpedaling with it's "that's not hacking" comment to Gamespot. "Kinect for Xbox 360 has not been hacked--in any way--as the software and hardware that are part of Kinect for Xbox 360 have not been modified. What has happened is someone has created drivers that allow other devices to interface with the Kinect for Xbox 360. The creation of these drivers, and the use of Kinect for Xbox 360 with other devices, is unsupported. We strongly encourage customers to use Kinect for Xbox 360 with their Xbox 360 to get the best experience possible." http://www.gamespot.com/xbox360/sports/thebiggestloserultimateworkout/news.html?sid=6283696 http://www.gamespot.com/xbox360/sports/thebiggestloserultima...
- flogic 16y agoYeah. I thought it was some exec shooting his mouth off the first time. There didn't seem to be much a of a traditional DRM reason to lock the Kinect down. So the most obvious answer is it wasn't.
- BarkMore 16y agoAt the start of a product cycle, game consoles are typically sold at a loss. Manufacturers recoup this loss through licensing fees paid by game publishers. If Microsoft is selling the Kinect at a loss, then Microsoft will be motivated to keep it locked down to ensure that they can recoup the loss through licensing fees.
- pyre 16y agoThe Kinect isn't a game console. It's possible that they are selling it at a lost, but not likely. That said, Nintendo doesn't sell game consoles at a loss (at least they didn't with the Wii). I think that by 'typically' you mean that Microsoft and Sony do it. I have no idea if Sega or ATARI ever did that for their consoles.
- iamwil 16y agoThe code for the camera.c is here: http://git.marcansoft.com/?p=libfreenect.git;a=blob;f=lib/cameras.c;h=412b465fd3ea66a02d87f4d2f2dac5b60ce330eb;hb=HEAD http://git.marcansoft.com/?p=libfreenect.git;a=blob;f=lib/ca... I've always wondered how people reverse engineer these things. Do they just guess what the interface might be based on the chips? Or are they able to probe it somehow through the port?
- ladyada 16y agoyou can probe USB commands, but that takes a lot of time. much faster to connect a usb analyzer and then 'replay' to see what commands do what. http://www.adafruit.com/blog/2010/11/09/kinect-hacking-video-and-data-dump/ http://www.adafruit.com/blog/2010/11/09/kinect-hacking-video... (demo of analyzer) http://github.com/adafruit/Kinect http://github.com/adafruit/Kinect (USB log dump)
- troutwine 16y agoI loved this book as a kid: http://www.amazon.com/Reversing-Secrets-Engineering-Eldad-Eilam/dp/0764574817 http://www.amazon.com/Reversing-Secrets-Engineering-Eldad-Ei... It's probably a bit out of date now, but my dog-eared copy is still a good read. Ah, nostalgia. There once were days when I dreamed that a CS degree would make me as a god; the silly thoughts of a child. Now I know that it is a _PhD_ which makes gods of men.
- lowglow 16y agoCan I get a Reverse Engineering PhD?
- mechanical_fish 16y agoYou can study molecular biology and become an expert at reverse-engineering the most amazing machines in existence. Though the Kinect is apparently a lot more tractable.
- vault_ 16y ago
- markbao 16y agoOh man. Ordering one ASAP. So much cool stuff could be done with this. Going to try to create a gestures thing so I can browse my email from bed.
- guelo 16y agoCould this all have been genius marketing by Microsoft?
- markbao 16y agoI'm imagining a sweaty Ballmer holding an impromptu press conference tomorrow announcing a Kinect SDK screaming Developers! Developers! Developers! Developers!
- sandipc 16y agoPerhaps. Although there is speculation that the Kinect is a loss-leader, so that wouldn't be the smartest move.
- markbao 16y agoI'm worried that this will lead to bad consequences by Microsoft to prevent the misappropriation of Kinect devices, which is very, very bad. Hopefully we'll see a teardown and a BOM sometime soon...
- flogic 16y agoI think it's probably an executive with enough power to say things but without enough knowledge to know what he's saying. That's fairly normal for large companies.
- electromagnetic 16y agoI thought it was mandatory for large companies. If lower-upper management actually had new ideas they might usurp someone elses power and then where would the top execs be? And where would the company be then!? (besides rapidly bankrupting itself through moron ideas)
- InclinedPlane 16y agoThis is a misleading title. The Kinect sensor has been hacked, but Kinect proper is a combination of hardware and software. Arguably the more interesting aspects of Kinect are in the software. That being said, this is still pretty cool, it'll be interesting to see what people come up with using this technology.
- modeless 16y agoHonestly the hardware is more interesting than the software. Yeah, skeleton tracking is cool, but the hardware is capable of so much more. 3D scanning, mapping, and localization for robots come to mind. With the microphone array built in, Kinect is basically begging to be the eyes and ears of a robot.
- teamonkey 16y agoRight now the Kinect drivers can't do anything that a pair of cheap USB webcams can't. The only advantage seems to be the on-board depth processing instead of having to use something like OpenCV. http://opencv.willowgarage.com/wiki/ http://opencv.willowgarage.com/wiki/
- catch23 16y agoYeah, but it does make it easier and more accessible to those who don't hack with OpenCV every day. One could also argue that one can always build digital components from scratch instead of using something like an Arduino.
- dimatura 16y agoA pair of cheap usb webcams are pretty suboptimal for stereo vision. To start, they aren't synchronized. Plus you have to rig them somehow to know their relative positions. They may use rolling shutter, which is bad for stereo. It's not that it can't be done, but it's not easy.
- greendestiny 16y agoIt's a cheap and off-the-shelf colour and depth capturing from IR structured light. That's nothing to scoff at. A pair of cheap webcams only gets you trying to do real-time depth processing from passive stereo and thats not easy.
- joshu 16y agoI would have thought there was some onboard CPU on the kinect, based on the power requirements (it can't be powered by a USB port alone.) If so, I suspect that any heavy lifting the unit does is probably by software that uploaded to the camera via USB at startup. Anyone have further details?
- icegreentea 16y agoThere is an onboard CPU on the kinect, but it doesn't do all the work. It still needs the 360s CPU to finish the processing and such. As a result, Kinect games will suffer a bit visually compared to normal 360 games. It's outlined in the ars technica review (and I'm sure in other places) http://arstechnica.com/gaming/reviews/2010/11/buy-a-house-clean-your-floor-move-your-butt-ars-reviews-kinect.ars http://arstechnica.com/gaming/reviews/2010/11/buy-a-house-cl...
- wmf 16y agoYes, there's at least one CPU. It looks like the Kinect performs depth extraction on-board and the 360 performs gesture recognition. http://www.ifixit.com/Teardown/Microsoft-Kinect-Teardown/4066/1 http://www.ifixit.com/Teardown/Microsoft-Kinect-Teardown/406...
- mattmanser 16y agoWhich, as stated elsewhere in the comments, is the really interesting bit of this tech. On the otherhand, it's still an impressive hack in terms of speed.
- sparky 16y agoCertainly there's some post-processing going on on the Kinect; whether it's via CPU, ASIC, DSP, or FPGA I have no idea. I'd imagine there's some signed code image that is factory-installed to some Flash or EEPROM on the Kinect; it's probably upgradeable via USB, but I don't think it can rely on the code being transferred over every time, since the posted driver gets depth images off the Kinect without doing so. EDIT: The link posted by another commenter http://www.ifixit.com/Teardown/Microsoft-Kinect-Teardown/4066/2 http://www.ifixit.com/Teardown/Microsoft-Kinect-Teardown/406... (Step 11) shows that the Prime Sense reference platform has Flash storage, almost certainly for code and calibration data.
- augustl 16y agoI always wanted to be able to set focus on windows by looking at them. Perhaps that can be achieved with a Kinect.
- orangecat 16y agoYou should be able to do that with a normal webcam, since you don't need depth information. I've thought of that too; I think there will be a similar interface when heads-up displays in glasses become viable.
- a_m_kelly 16y agoI haven't been paying attention, but has eyetracking software gotten that good? Can you point to people or companies who are working on this, or currently available solutions? I've been doing some usability testing stuff and it'd be nice to have eyetracking (especially paired with click/mouseover data.) and not much less helpful head/face tracking that is built into the webcam.
- spicyj 16y agoGazeHawk (YC funded) is, but the software isn't open. http://www.gazehawk.com/ http://www.gazehawk.com/
- samlittlewood 16y agoCommercial use: http://www.gazehawk.com/ http://www.gazehawk.com/ Some open source: http://www.inference.phy.cam.ac.uk/opengazer/ http://www.inference.phy.cam.ac.uk/opengazer/ http://sourceforge.net/projects/gazetrackinglib/ http://sourceforge.net/projects/gazetrackinglib/
- rbanffy 16y agoIf I am wearing glasses it becomes much easier (3 IR LEDs, one webcam) to track where my head is turned.
- andrewcamel 16y agoWhat would be very interesting, is if you could mod the device to work with a better camera. Then, it would probably be useful in the photography industry. Maybe it would allow you to correct issues with lighting? It would allow someone editing pictures to easily select a part of the picture in the foreground or background. With selections being much easier, you could enhance specific parts of photos to make them stand out around other less-important parts without much effort at all. I'm sure there are many more applications for this technology in the photography and even videography industry. Any ideas?
- shogunmike 16y agoThis is an exciting achievement and I'm very impressed that it was carried out so rapidly. Good hacking indeed! Although, I have two questions which HN may be able to answer for me: 1) What are the benefits of the Kinect over building a servo-driven IR bar with audio yourself out of cheap commodity hardware? Is the price far less when all components are integrated? Is the construction just that much simpler? 2) Presumably now that the "easier" task of reverse engineering the comms protocol has been achieved, the next step is to understand/replicate/replace the "proprietary" algorithms in use by Microsoft that run in the XBox in order to have some meaningful interaction with the device. Is it possible to use some FOSS such as OpenCV with Kinect? I know it's early days and many of you probably haven't had time to look at the protocol yet, but I am curious.