6 ms·
Google's self-driving car gathers almost 1 GB/sec
- peterwaller 14y agoFor perspective, the ATLAS [1] experiment at the LHC records O(400 MB/sec). To disk. Permanently. (With a duty cycle of something like ~0.5, in principle). So, I guess that's a different ballgame than temporary acquisition for decision making, but still. A decade ago it seemed like an insane amount of data and now it is becoming more normal by the day.. ATLAS "sees" something more like 1.5 MB * 40 MHz, but the vast majority of it is discarded after at most three seconds and there is zero suppression involved. Most of "the full data for a collision" isn't even involved in the decision making whether to keep a particular event. [1] http://atlas.ch/ http://atlas.ch/
- Jabbles 14y agoA number I've found useful is that 1080p60 raw video is roughly 1Gb/s (using YUV). So the car has the equivalent of 8 such cameras. Doesn't seem unreasonable.
- HCIdivision17 14y agoThe impressive bit is paying attention to that much meaningful data. It would be extremely taxing to actively pay attention to that many screens for an extended period of time; granted, filtering limits that, just as peripheral vision does for us. I tend to take for granted the immense amount of data processed subconsciously.
- iharris 14y agoThere's a great presentation about Google's self-driving car here (check the second half for video of the real-time telemetry that it gathers): http://youtu.be/YXylqtEQ0tk http://youtu.be/YXylqtEQ0tk One of the things that I found really interesting is how the car inches forward at a stop sign in order to show the "driver's" intent to other drivers. Lots of actions that seem to be second-nature for human drivers have to be carefully emulated here.
- kyrra 14y agoThanks you for the link. It looks like the picture here is almost the same as what is shown in that video (from 1.5 years ago).
- Samuel_Michon 14y agoIt is exactly the same. The picture on Twitter was the frame shown on 9:07 in the video. Given that the image is from a 1.5 year old promo video, which probably has been circulating all over, that puts the rest of the information in a new perspective as well. Here’s a comparison I just put together: http://imgur.com/IfxYZL2 http://imgur.com/IfxYZL2
- hammock 14y agoDear moderator, why did you change the title? I worked hard to abbreviate it to 80 characters without changing the wording or editorializing. And it's not the fact that I found interesting, it was the picture. Thanks. For the record I had GOOG Self-Driving Car gathers almost 1 GB/sec.What it "sees" making L turn [pic]
- dsl 14y agoI really dislike the mods here changing titles to bend to personal views. I've had a few submissions that gained good traction and got heavy upvotes until a mod changed the title to something meaningless and unrelated.
- jlgreco 14y agoThey seem to mostly change the titles to what the title of the actual article was. This is of course a terrible policy when the blog in question [edit: does not] use descriptive titles, or titles that only make sense if you are coming from the perspective of already being on the blog.
- dsl 14y agoA good example would be the post I made about a third party audit of CloudFlare's security and how they failed to block any of the most basic widely known attacks. The mods change to the academic title of the PDF paper failed to provide any sort of enlightenment about why it was interesting at all to HN readers.
- AJ007 14y agoSome stories would drop off the front page fast if the original title was used initially. By the time the moderator changes it, usually there is enough weight that people read them because of the # of upvotes.
- Houshalter 14y agoA lot of the titles are terrible. Like a single word or phrase that means absolutely nothing without context. I hope the mods are not doing that.
- DasIch 14y agoDoes anyone know what happens with this data? Obviously it is analyzed in realtime for driving but is it also stored for machine learning purposes? Is that data shared so that other cars can take advantage of it?
- dsl 14y agoIt's 1 GB/sec of data from sensors. Likely processed, but not stored. To get 1 GB/sec write throughput in a moving car you would need to be using some form of solid state storage, which would be pretty darn pricey over an hour test drive.
- spellboots 14y agoIt's likely far cheaper to store it than it would be to run the test again. This is Google, they can certainly afford it – I'd be incredibly surprised if they weren't storing it.
- dsl 14y agoHaving developed autonomous vehicles in a previous career, I can tell you that raw sensor data is far less useful than you think. By the time you are starting to hand over controls to the system itself you are pretty damn confident that your pipeline up to the control logic is all very solid. Also, i'm not entirely sure what you think the costs involved in a test are? We purchased about 20 acres of land for a test track, but that was the only real expense involved in day to day development.
- Game_Ender 14y agoThe true data rates (see my other posts) are most likely around 5-10 MB/s. Which is so low the benefits out weigh the costs. After all, what if their is an issue with the software? How are you going to reproduce without the logs, especially on a R&D system like Google has (yes it's still R&D, they can't even drive in the rain).
- jewel 14y agoFor reference, the raw RGB data for 1080p video at 30 fps works out to 178 MB/s.
- salman89 14y agoWhat are things city planners can do from an infrastructure perspective so that we can drop the amount of data that needs to analyzed in real time? For example, can we use special paint for road lines in order to make the cost of detection of road lanes lower?
- notatoad 14y agokeeping up with maintenance is probably the most important thing towards making either self-driving or human driven cars safe. faded, worn, or poorly-visible road markings and signage has got to be a huge challenge. Signage and marking is already very well standardized and optimized for low ambiguity. making anything special is probably just going to make things more difficult - the cars have to be able to drive anywhere, regardless of whether the road has the correct markings or not.
- salman89 14y agoI'll argue that signage and marking is already very well standardize and optimized for low ambiguity for human vision, but we are able to build things that humans cannot see but technology can. The cars do have to be able to drive anywhere, but that doesn't mean we cannot improve quality of service in other areas. Suppose we can build roads where self driving cars can safely travel 100mph+ due to special infrastructure - I do see that as a big benefit.
- Maxious 14y agoSome people are using LiDAR/computer vision to decide where maintenance is needed http://www.nicta.com.au/media/previous_releases3/2012_media_releases2/nicta_video_analysis_technology_takes_north_american_road_trip http://www.nicta.com.au/media/previous_releases3/2012_media_...
- iharris 14y agoI'd love to see better integration of live traffic safety data into the cars' navigation (ie. Highway police logging lane or road closures). So, if there's a big accident on a major freeway, cars will automatically begin to find early detours rather than getting caught in gridlock.
- Game_Ender 14y agoHe is off by an order of magnitude. The Velodyne 64 on that car only has a 100 Mbit connection [1]. Each of the 5-10 radars on that vehicle is connected over a 1MBit CAN bus [2]. The front facing is almost definitely a Gigi-E or Firewire camera so it's at most 1000MBit. Doing the math: 100 + 10*1 + 1000 = 1100MBit != 8192Mbit (1 GB) 1. http://velodynelidar.com/lidar/products/brochure/HDL-64E%20S2%20datasheet_2010_lowres.pdf http://velodynelidar.com/lidar/products/brochure/HDL-64E%20S... 2. http://www.kvaser.com/zh/about-can/the-can-protocol/19.html http://www.kvaser.com/zh/about-can/the-can-protocol/19.html
- VikingCoder 14y agoDoesn't it also know about Google Maps data? Meaning, it can look at a lot more data than just its raw sensors, every second. Also, why do you assume the front-facing camera is the only one?
- Game_Ender 14y agoAs far as I know the "google maps" data is used for things like road locations, stop signs, and other traffic marker information. Their primary mapping data source is based on Velodyne data itself. You also have to think storage needs, would it really have 4-6TB storage array for just a few hour drive? I saw the tech lead of the project talk about 1.5 years ago. He said the primary sensor was the Velodyne, followed by radars. The only use for the camera mentioned is detecting stop light colors. At that time their main computer was a quad core machine, processing that much data sounds beyond it's limits as well.
- croddin 14y agoHow much data does a human driver gather per second?
- deleted 14y ago[deleted]
- deleted 14y ago[deleted]
- roc 14y agoFrom what I've seen on the highway? About 160 characters.
- conductor 14y agoComputers get hacked evey now and then, I predict software assassinations in the future, i.e. somebody hacks into a self-driving car, installs a software component which will be activated at some point (i.e. when it identifies a specific car/human and crash into it). Then it can auto-destruct, no evidence left. I ask, who will be responsible?
- piyush_soni 14y agoProbably find the hacker? Just like what we do right now ...
- DasIch 14y agoYou are assuming detecting manipulation is straightforward or even possible. What if someone is able to MITM software updates?
- piyush_soni 14y agoI'm not assuming it's possible or feasible. I'm saying the problems are the same even as of today - it's difficult even now. Of course, hackers capabilities will increase, but same goes with those who are trying to catch them. Eventually, everyone will be monitored though ... And apparently US govt. has already started doing that ...
- conductor 14y agoHere are my analyses: When somebody hacks into one's computer, he can't do any physical harm, he sure can steal money, spy on the victim, but he can't make the computer burn or somehow harm the victim. The computers that can be used for doing real damage (i.e. bomb activation, drone command and control centre, etc.) are well protected from the hackers (not connected to the internet and physicall inaccessable). Controrary to this, the self-driving cars are potentially dangerous and will be widely accessable and hackable, I see this as a real problem. We should not allow a computer to do things that can kill people, and a computer-driven car can kill people.
- cstavish 14y agoWould it be possible for someone to remotely interfere with the sensors on this car, causing a malfunction or collision?