4 ms·
Though impractical to implement, this is an interesting thought experiment. What if the autonomous driving system has a "chaos monkey" that required interventio
by snaily 9y ago
Though impractical to implement, this is an interesting thought experiment. What if the autonomous driving system has a "chaos monkey" that required intervention by the trainer every so often?
Note that we already do this to keep people vigilant in rote tasks, e.g. for airport x-ray scanner operators or train drivers.
- femto 9y agoSelf-driving car companies are "newbies" who could learn from railway companies, which have decades of experience with keeping drivers alert in vehicles that keep moving without driver action. For example, locomotives have "dead man" switches to make sure the driver is still on the job. Japanese drivers are trained to point and vocalise. Why shouldn't the car drivers be required to call and point out every hazard whilst in autonomous mode? Maybe part of the problem is that the self-driving companies view their drivers as temporary measures, so choose to invest their resources into the machine component rather than the human component?
- rtkwe 9y agoThe question is how do we do that in a way that is good enough to get engagement without actually endangering anyone. Imagine the uproar when one of these chaos monkeys cause a crash because the driver didn't react in time and it's evaluation of 'safe but seemingly dangerous' was just a bit off. For other systems this is easy because the system and the response are both totally contained inside the software so fake events are easy to generate and the user responds back through the system so the response can be caught and evaluated.