2 ms·
> What's stopping them from having their AI operate in simulations in literally every possible traffic situation? Every location a pot hole can be in, every typ
by qeternity 5y ago
> What's stopping them from having their AI operate in simulations in literally every possible traffic situation? Every location a pot hole can be in, every type of traffic cone arrangement, every kind of jaywalking, every kind of vehicle approaching any kind of street from any kind of location, possible speed, reaction time, everything? How could a government approve any autonomous agent that is not tested in such a way?
Because this approach has huge limitations, principally that you’re now optimizing against a cost function that isn’t the real world. RL has a place for sure, but limitations.
It’s like saying that you’d expect someone who’s played 10k hours of Call of Duty to be equivalent to a Navy Seal. They’re just really good at playing the simulation, not the real thing.
- tinco 5y agoI'm not saying they should optimize for these simulations, just saying they should test for them. Also simulations are definitely a part of military training, and if they perform badly in the simulation they'll have to fix that before going on a mission I'm sure. I don't know much about Navy Seals specifically, but I've got friends who built full body VR suits for special forces training.