4 ms·
> Letting a computer drive my car is high-risk: If there is a malfunction at 70mph, I could die! Google can't even make GPS mapping work perfectly - it's appar
by visarga 9y ago
> Letting a computer drive my car is high-risk: If there is a malfunction at 70mph, I could die!
Google can't even make GPS mapping work perfectly - it's apparent if you use it for a day. Not to mention that AI vision systems are susceptible to adversarial attacks, which means they can be hacked by external images. This paper just came out yesterday: "Breaking 7/8 of the ICLR 2018 adversarial example defenses" (https://arxiv.org/abs/1802.00420 https://arxiv.org/abs/1802.00420). The situation is dire.
I think they are afraid that drawing a couple of lines with a marker on a street sign might make it invisible, or turn it into another sign. They can't defend against such attacks because the neural net doesn't actually understand the world, it just observes patterns. Understanding requires causal reasoning.
- conception 9y agoWell map software on a phone isn't written to specs that account for liability for human life for one. Apples and oranges.
- jacquesm 9y agoIt should be. They're used as inputs to humans making decisions at highway speeds. Now obviously we allow this because we assume humans are intelligent enough and have enough of a model of the real world in their head that they should be able to cope with these issues but I see no reason why an AI driving a car should cross a lower bar. I fully expect that AI to take mapping errors into account and to survive them.
- tziki 9y ago>Not to mention that AI vision systems are susceptible to adversarial attacks ... The situation is dire. That's like saying a human driver can be blinded with a bright light so the situation is dire. New world, old rules. You'll still go to jail for manslaughter (or whatever the charge would be).
- kajecounterhack 9y agoFwiw maps used for autonomous vehicles are higher fidelity than consumer maps. Furthermore the cars are generally equipped with IMUs so that they don't get thrown off by urban canyons, clouds, etc. And more error correction (particle filters, visual cues + map data) is used to pinpoint your location on a map. Adversarial attacks are concerning for any AI model, but autonomous vehicles aren't all AI. Lots of rules and heuristics and pre-knowledge are utilized. In the end if something is uncertain it generally amounts to "slam on the brakes" which is more a ux problem than a safety problem.
- Twisell 9y agoThere is no « better quality » map out there (unless maybe military and restricted). Mapping the world is hard because it is complex and evolve way faster than a Google Car army can patrol it for a reasonable cost. More often than not OpenStreetMap which is a community project is more up to date than commercial map, but it’s not precise enough. Beside nobody would bet there life on something that is Wikipedia-like editable by ill-intentioned trolls. This is precisely why all autonomous car rely heavily on computer vision and why adversial attacks should be carefully considered. Uncertainty will indeed « slam on brake » but adversial attack don’t aim to generate uncertainty the aim to generate false certitudes.
- kajecounterhack 9y agoNope. There are higher fidelity maps. You should read about robotics. It's true these maps don't exist for the whole world yet but it's also why all sdc companies are launching in metros. They're building them. Vision is good at recognition but bad at localization. This is the real problem. In robotics a fundamental problem is SLAM. You should read about it.
- Twisell 9y agoCould you explicit acronyms? They seem very business specific but I would gladly learn about theses projects as I often use cartographic products for my work.
- 9y ago