6 ms·
Seems really scary to exclusively use a neural network for safety-critical tasks like this, without having an explicit method guaranteeing safety. You can't pr
by devit 7y ago
Seems really scary to exclusively use a neural network for safety-critical tasks like this, without having an explicit method guaranteeing safety.
You can't prove that a trained neural network is always correct, and thus this is likely going to kill someone at some point.
I think you definitely need a LIDAR (or in general something that can give an accurate 3D map of all surroundings) and some explicitly written code that can be proven to result in never hitting a car going the opposite direction in the opposite lane (provided they stay in their lane), as well as never hitting stationary obstacles and never going off the side of a mountainside road.
- _Microft 7y agoMy cat's collision avoidance can be both outstanding and abysmal. Context: she's running a purely vision based system at the moment (supported by elastic proximity sensors at the snout and excellent remote sensing for both chemical and acoustic stimuli) and she still bumps against my leg several times a day. And not just once but repeatedly. Something might be bugged here as she's not having issues with any other static and most dynamic objects either. I'm not sure about the details but since she's not getting any explicit upgrades to her high resolution 3D map, so she might using an advanced SLAM system. The latter is supported by observations that she has no troubles moving in previously unseen environments like while being at the vet. Acceleration is good, agility as well, still sure-footed too, so her movement predictions and the execution seem to match well. So the only complaint is the frequent bumps against my leg. Maybe her system is misclassifying something as she's not having problems otherwise. Does not need to have a LIDAR upgrade, I think. Edit: thinking of it more she does show this exact problem with other objects as well. Might need to debug her or get a decision-explaining version of her net installed.
- solarkraft 7y agoJust in case you're not trolling: Cats do this intentionally to show affection, scratch themselves and mark things.
- gnode 7y ago"It's not a bug, it's a feature."
- chronolitus 7y agoSeems like the company which built her model really took it's time designing and testing the software.
- littlemtman 7y agoI dont need LIDAR for it. It is very expensive and doesnt have a lot of image points to train on, at least compared to images so 480p for example.
- yitchelle 7y agoWhat's the alternative to LIDAR that is working?
- littlemtman 7y agoCameras, it works for humans
- lnsru 7y agoNo. It’s intuition while you drive in snowstorm or heavy rain. Sane driver should pull over immediately and wait. Source: driving fail videos and personal experience. I am really scared to drive slowly and safely during snowstorm, there is very real risk to be reared by some idiot flying twice the speed I drive.
- littlemtman 7y agoIn the end those are just mathematical models and not intelligence. Humans interact based off on their experience and it is really hard to find training data with a snow storm.
- deleted 7y ago[deleted]
- TulliusCicero 7y agoHumans have a deep and subtle mental model of How The World Works. Programs, even ones with 'deep learning', don't have that. Their understanding is actually fairly shallow, which is why it can be very useful to compensate for this using sensor equipment with superhuman capabilities.