2 ms·
Yes. Again, "If the automated control system behaves consistently and reliably for prolonged periods, the user of that system can become complacent about its op
by Animats 6y ago
Yes. Again, "If the automated control system behaves consistently and reliably for prolonged periods, the user of that system can become complacent about its operation and may not respond appropriately when a situation requires him or her to act." That's what led to the accidents where a Tesla plowed into a freeway divide barrier (California), a street sweeper (China), a parked van (Germany), a fire truck (California), a semitrailer (Florida), an overturned truck (Taiwan) ...
There's a certain similarity to Tesla autopilot crashes. Everything was going just great until Tesla's automated system failed to detect a big solid obstacle. Tesla drivers need to be very aware of that failure mode.
It's amazing that Tesla is allowed to ship that. It's Musk's "we don't need LIDAR, we'll just kill people instead".