4 ms·
Just in case someone is wondering, we are not even remotely close to technology like this. The control problem is very hard, but the perception problem perhaps
by karpathy 14y ago
Just in case someone is wondering, we are not even remotely close to technology like this.
The control problem is very hard, but the perception problem perhaps even harder, Especially when most of the processing needs to be done onboard because you need the perception to be part of the control loop and work at reasonably high frequencies. Higher-level perception tasks such as identifying power lines or people are even further out.
- ckvamme 14y agoHave to disagree with this. This exact technology is operating right now, just not as small. The perception problem is the second hardest (behind power) but still totally possible. On a Raspi running at 800MHz one can get 5-10 fps while running intense vision algorithms. I'd say a micro multicopter with real CV capabilities is possible right now.
- sliverstorm 14y agoThis is the disappointing part; every objectively impressive drone video I've seen has been controlled by a centralized computer with a bunch of cameras watching the drones and controlling them accordingly. Long way from group of drones that can fly anywhere and operate in any conditions.
- derringer 14y agoIdentifying power lines and people isn't necessarily as hard as you say. With a simple image, it's true machines can't match human perception. But when you take into account infrared for viewing human profiles, magnetic sensors for checking for power lines and the fact that the bots are mobile and can investigate and base their analysis on 3d space. The computational bang for your buck is also continuing to improve and sensors are continuing to get smaller. These systems aren't possible yet, but they may be in the relatively near future.
- IheartApplesDix 14y agoActually, there is commercially available optical flow sensors available today.
- scoot 14y agoI laughed when I heard the reference to optical flow sensors, like somehow strapping an optical mouse sensor (albeit with appropriate lens technology) to the bottom of a drone somehow solves all the sensing and control problemthin loved in bringing this technology to the mainstream. An optical flow sensor has very limited utility; it's possibly the least useful of all the sensors you could add to a UAV. It's inclusion in this video was purely marketing fluff for the technically illiterate, thanks to its fancier-than-it-actually-is sounding nomenclature.
- IheartApplesDix 14y agoObviously, Optical flow sensors are a bit more complicated than mouse sensors, (although similar). Optical flow is very similar to how insects judge their relative location, and it's a critical component in existing advanced drone technology, early in application, but almost a decade old in theory.
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]