12 ms·
Autopilot: an open source driving agent
- dejawu 10y agoThis is great IMO. I was incredibly dismayed to hear they were canceling the Comma One without any further action, without even attempting to work with regulators. This seems like the culmination of that - now the responsibility for safety is in the hands of individual users/developers and not on Comma, which is what got them in trouble in the first place. Now that this is open source though, I wonder what their next project will be?
- sounds 10y agoI have my reservations about this code. I am a long time free software developer so it is hard to say it but it seems clear to me that a single entity (from a legal perspective) has to "own" the self-driving car software. In the future bits of a self-driving car system may get open-sourced the way Facebook Open Compute has emerged in data centers, but first the proprietary implementations will need to pave the way in the legal world. It's not all bad news, though: I'd love to see a free software project that converted my lawn mower into a self-driving lawn mower...
- jstanley 10y ago> it seems clear to me that a single entity (from a legal perspective) has to "own" the self-driving car software. That's not clear to me at all. It seems clear to me that the person operating the vehicle has ultimate responsibility for how it is driven, whether they're personally driving it or not.
- andars 10y agoInteresting opinion. However, this isn't current U.S. law. See, for example, the numerous successful suits against Toyota for unintended acceleration. In addition, it may soon be questionable to say that an occupant of a vehicle is "operating" said vehicle if it drives entirely autonomously.
- xg15 10y agoThat's not clear to me at all. It seems clear to me that the person operating the vehicle has ultimate responsibility for how it is driven, whether they're personally driving it or not. Seems reasonable at first glance, but responsibility makes only sense if you also have the knowledge and power needed for making the right descisions. Unless the driver is expert in the self-driving car field and core contributor to the car software, he'd end up being liable for events he cannot anticipate and has no control over. In such a situation, the only actually responsible descision would be not to use the car at all.
- __jal 10y agoI don't see why. Liability for other dangerous, complex artifacts don't necessarily follow that rule, even when it comes to software, and even when it comes to open source software. GPSd is one example. Used pretty much everywhere, including life-and-death real-world situations. Consumer products (like your car's GPS) including it tend to pop up a "don't be an idiot, but we're not liable even if this malfunctions" screen. (The Pentagon and oceanic research operations, well, I'm the wrong person to ask about how they handle software liability, but kinda doubt we'll see class actions from either.) But the important part is that that screen is not there to protect the authors of GPSd. It is there to protect the VAR.
- serge2k 10y agoYou can solve that problem with certification. Sure, the software platform is open but actually building a car and getting it to the road requires certification of the final product.
- gridspy 10y agoAssuming that what you say is true, I believe the distinction here is that a single entity here must package, release and deploy the driving software. But like RedHat and Ubuntu, building a distribution of well proven and flexible open source software is likely the best route to success.
- deleted 10y ago[deleted]
- revelation 10y agoThis seems to be a code dump from the comma AI startup. It also indicates their autonomous driving platform runs on a "stripped version" of Android. Which seems to indicate that they are clinically insane, given they are using a system that can easily have excessive scheduling latencies under load to steer a car.
- 6stringmerc 10y agoPeople like me laughed at Android platform adherents because audio latency was a huge hurdle to even remotely be on par with Apple's Core Audio, but, believe it or not, 8 years later (give or take) Android has caught up. Point being, what might be "clinically insane" to you is simply a "fun challenge" to people who may be smarter than the both of us combined.
- wyager 10y agoIt's not about being clever with Android programming; it's about the fact that Android is not by any stretch of the imagination a real-time system and should absolutely not be controlling a car.
- jaclaz 10y agoActually the thingy is called "openpilot", there is already enough confusion with Tesla calling its thing "autopilot".
- Matthias247 10y agoReally, a safety critical hard realtime system with control loops on top of Python, a general purpose OS and a CAN-USB adapter? There are reasons why we have realtime operating systems, deterministic bus systems and dedicated CPUs for these kinds of applications. That might be an interesting research, prototyping or simulation platform. But nothing you want to have on a real public road.
- randomdata 10y ago> these kinds of applications. As in research projects, which this project expressly states that it is? What are those reasons? It seems like being able to test theories as quickly and cheaply as possible is the top priority. If Python, a general purpose OS, and a CAN-USB adapter is sufficient to conduct the research and satisfies those attributes, it seems like the perfectly logical way forward. I understand why you would want to move to such systems you describe once your research has concluded and you are now building something for production, but that is not the intent of this project, at least at this stage. It specifically says so.
- ryaneager 10y agoWhy wouldn't you do the research on a platform that could actually be deployed? Build the core using the proper tools and techniques. Any bug in a system like this could be life threatening at worst. Wouldn't you want to use the research phase to help eliminate such bugs? Unless you're not planning on ever releasing then a platform like this makes sense for strictly research, but Comma AI did plan on releasing their product until they got shut down.
- randomdata 10y agoResearch implies that you don't know the outcome and are going to be throwing away everything that doesn't pan out. Without knowing the outcome, how can you really be sure of what you need? You might think you need a CPU-based system but learn that GPUs are necessary, for instance. If you can start with cheap off-the-shelf components, at least you don't have much to loose when it is time to throw it away. If you're spinning your own boards, or heavily tied to expensive development kits, that becomes much harder to swallow. Especially for a startup with limited resources. > Wouldn't you want to use the research phase to help eliminate such bugs? I wouldn't think so. Spending your time fixing bugs in something you realize could have been done better another way, which ends up getting thrown out, seems like a waste of time. The words research and development are often paired together because it is a two step process, where development comes after you have learned what can be done.
- Voloskaya 10y agoNot everything seems to be open source. I can't seem to find the vision part, only the binary, see: https://github.com/commaai/openpilot/tree/master/selfdrive/visiond https://github.com/commaai/openpilot/tree/master/selfdrive/v...
- bri3d 10y agoBased on a really cursory inspection of the binary and symbols, the binary seems to be an OpenCV project which uses some common image processing algorithms (Sobel edge detection, Hough to find straight lines). There doesn't seem to be a large amount of embedded data indicative of a trained model or neural network. So, it seems that the vision algorithms probably mirror those in the common literature and represent a reimplementation or iterative improvement on existing lane-finding systems. More reversing would probably yield greater insight :)
- paulbaumgart 10y agoI think it's also using Qualcomm's FastCV, judging by the fcv* prefix on a lot of the symbols. Which makes sense, since FastCV is optimized for the Snapdragon processor in the OnePlus 3 phone they use.
- Voloskaya 10y agoI did the same thing as you, and found reference to RNNs, ReLus etc... That was the part I was really looking forward to see open sourced, but well :)
- commaai 10y agoThere's a neural network in there :)
- bri3d 10y agoHa, straight from the horse's mouth - I stand corrected :) I think this will be the first binary I've pulled apart with one, look forward to it!
- 10y ago
- sheeshkebab 10y agoAwesome! not sure about using it my real car, but I'd stick that on an RC car if it works. wondering whether this can run on raspberryPi...
- pmoriarty 10y agoI read an interesting ethical dilemma related to self-driving cars recently. Imagine that a self-driving car detects a child in the road, and the only way to avoid hitting the child is to crash the car in to a wall, certainly killing the driver. What choice should the car be programmed to make? Who should decide what that choice is? Who is ethically responsible for that choice? In a normal car that is driven by a human, the choice is obviously made by that human and the responsibility is theirs. But with self-driving cars it's not so clear.
- shostack 10y agoTo further complicate it...would this be standardized? Would a cheap economy car opt to kill the driver, but a Mercedes try to preserve the driver at all cost? How much say would insurance companies that insure the automakers have? What about the government? Also, what level of information about how this logic works is necessary to share with a potential buyer to judge them sufficiently informed? I know I'd sure as hell want to know if there were scenarios in which my car would decide my life was not worth saving so I could do my best to never even come close to making one of those scenarios potentially possible.
- maxerickson 10y agoAnd what if the child's parents have paid Mercedes to avoid hitting their kid? You think you are safe in your golden Mercedes, but not when the kid's got Platinum Protection on his phone!
- canada_dry 10y agoOooh, so then maybe I'll be able to pay Mercedes (or more likely VW) to target the neighbors kids... I've never liked them little brats. ;)
- dchuk 10y agoThis is a variation of the classic ethical debate of the Trolley Car Problem: https://en.wikipedia.org/wiki/Trolley_problem https://en.wikipedia.org/wiki/Trolley_problem There is really no "right" answer in the absolute sense, but it's a great party trick to toss out there for a group of people to debate over.
- openasocket 10y agoCorrect me if I'm wrong, but if I were actually to install this in my car, that car would no longer be street legal, right?
- striking 10y agoThe car would likely still be street legal. (IANAL) However, allowing this system to take control of your car on a public road would not. Another way to say this is, there's nothing dangerous about the hardware. You could be using it as a logging platform for the data on the CAN bus in your car. But letting the software send commands and take control from a driver is a different story.
- darawk 10y ago> The car would likely still be street legal. (IANAL) However, allowing this system to take control of your car on a public road would not. IAANAL, but I don't think even that is true. I think it actually is legal to allow it to take control of your car, provided you are still sitting in the driver's seat and can take control back at any time.
- BoringCode 10y agoIANAL (can we get a real one in here?), but it depends heavily on your jurisdiction.
- openasocket 10y ago> can take control back at any time but if you're going down the highway and the AI decides to suddenly swing the wheel far right as quickly as possible, no human being would have reaction time good enough to recover without crashing. I'd be pretty concerned if you could add an autopilot to your car and drive it around on public roads without any sort of demonstration of safety.
- espes 10y ago> but if you're going down the highway and the AI decides to suddenly swing the wheel far right as quickly as possible, no human being would have reaction time good enough to recover without crashing "The EPS controller in the car limits the torque to a very small amount, so regardless of the message, the controller cannot jerk the wheel" [1] [1] https://github.com/commaai/openpilot/blob/master/SAFETY.md https://github.com/commaai/openpilot/blob/master/SAFETY.md
- devy 10y agoGeorge Hotz once said[1], if Tesla Autopilot is the iOS, Comma.ai's system is the Android. Today he's the MAN of his words by open sourcing Comma.ai openpilot. Big kudos to Geohot! [1]: http://learnbonds.com/131150/tesla-ios-self-driving-comma-ai-android/ http://learnbonds.com/131150/tesla-ios-self-driving-comma-ai...
- jesionaj 10y agoHmm, the usage of .dbc files is interesting. That format is owned by Vector and proprietary. I'm curious as to what the limits of using DBC are, as I'd love to integrate them into the product I currently work on without paying thousands of dollars for the official API from Vector.
- influx 10y agoCurious why this isn't using PEP8? Another Xoogler?
- CamperBob2 10y agoWhy is the zipfile encrypted?
- moflome 10y agoInteresting project, and valuable within the context of a larger autonomous system like the Robinos [0] autonomous vehicle framework from Elektrobit. [0] https://www.elektrobit.com/products/eb-robinos/ https://www.elektrobit.com/products/eb-robinos/
- amelius 10y agoIs there a closed-simulation-environment to test this? By that I mean that the sensor inputs (images of the road, etcetera) are generated by the simulation environment with which the driving agent interacts.
- eriknstr 10y agoSpeaking of which, I've been wondering, if you have digital map data and and a process to generate a 3d model of map data and a renderer that produces photo realistic imagery in real-time, if that could be useful for training a neural network at driving a car by monitoring the position of the car on the virtual road using another piece of software and have it provide feedback to the neural network about how it is performing.
- pmuk 10y agoHave you seen their Dash / chffr phone apps? https://itunes.apple.com/us/app/dash-train-self-driving-cars/id1146683979?ls=1&mt=8 https://itunes.apple.com/us/app/dash-train-self-driving-cars... https://play.google.com/store/apps/details?id=ai.comma.chffr https://play.google.com/store/apps/details?id=ai.comma.chffr
- halayli 10y agoYou want me to trust my life with a source code that uses zmq? no thanks.
- agumonkey 10y agoHis latest video https://www.youtube.com/watch?v=vU26Pa6ERkY https://www.youtube.com/watch?v=vU26Pa6ERkY
- alinspired 10y agoCan this be good for other applications, ie drones or RC cars ?
- 6stringmerc 10y agoSo, ladies and gentlemen of Hacker News, following all the ire shoveled GEOHOT's way for closing up his project, can you please show me any equivalent Open Source contribution from major manufacturers that is comparable? Not like White Paper bullshit. I mean where has Tesla, Audi, or GM shared this kind of platform without Sam Altman writing a think-piece about how they're not as good as Cruise and he knows the truth and doesn't need to listen to fuckin' lawyers. Sorry, maybe that was an inappropriate aside but I know I'm loud & proud team GEOHOT and have yet to see the Giants in the industry really show they can fend off a determined Goliath.
- guomanmin 10y agoParticipate in Atlassian Research My name is Angela and I do research for Bitbucket. I’m kicking off a round of discussions with people who use Git tools. Ideally, I’d like to talk to people that sit on a team of 3 or more. If this is you, I would love to talk to you about your experience with <using> Git tools, or just some of the pain points that are keeping you up at night when doing your jobs. We’ll just need 30 mins of your time, and as a token of my thanks to those that participate, I’d like to offer a US$50 Amazon gift voucher. If you’re interested, just shoot me an email with your availability over the next few weeks and we can set up a time to chat for 30 minutes. Please also include your timezone so we can schedule a suitable time (as I’m located in San Francisco). Hope to talk to you soon! Cheers, Angela Guo aguo@atlassian.com