3 ms·
Academically certainly interesting, but everything I've seen on adversarial attacks against ML models relies on knowing the model or having a way to run the mod
by mschuster91 5y ago
Academically certainly interesting, but everything I've seen on adversarial attacks against ML models relies on knowing the model or having a way to run the model against attacker-determined input.
How would one go and attack a real-world vehicle? Essentially you'd need to gut a vehicle entirely, mock every sensor and actuator to fool the car's control unit to believe it is still driving a car... a lot of effort.
- XorNot 5y agoDynamos for vehicle performance are common, and GPS spoofing is not hard. In a world where AI driving systems are a couple of decades old and on the used car market now, obtaining the source hardware would be very straight forward.
- mschuster91 5y agoI'd seriously hope that any AI self-drive would not just use GPS and motor load sensors to learn its place in the world. You'd also need to spoof accelerometers, gyroscopes, multiple cameras and in case of everything except Tesla also LIDAR, and that convincing enough that no fail-safe is triggered.
- deleted 5y ago[deleted]
- elihu 5y ago> everything I've seen on adversarial attacks against ML models relies on knowing the model or having a way to run the model against attacker-determined input I thought that actually turned out not to be the case quite a bit of the time. An attack that's trained against one model will often work against different models as well, because the various models, even if trained on different data, will often end up looking at similar features. I'm not an ML expert though, so maybe someone with more knowledge can chime in.
- asdff 5y agoOr, you could just pull a page from intelligence agencies. All you would need to do is bribe or radicalize a disgruntled employee, then you'd know the model.