But we can't allow Google to have the same amount of accidents as regular drivers, because we are not allowing them to have the accidents in the first place. "E

But we can't allow Google to have the same amount of accidents as regular drivers, because we are not allowing them to have the accidents in the first place. "Everyone" breaks the code and the police is not enforcing unless some special conditions happen (e.g. the infraction is in front of a policeman or a well marked speed trap). The code generally is designed to prevent accidents, e.g. by stating that if there is a child nearby a road, you should slow down. But how often do you see drivers going significantly below the limit because of pedestrians on the sidewalk? Now, drivers take these risks because they subconsciously learned that the probability of accident is vanishingly small, while probability of being honked at for going anything below the limit is rather large. Thus, they subconsciously balanced the expected reward/punishment to lean to the direction of taking the risk. But AI is always aware of the risk and very well able to calculate it. Now imagine the headlines "Google's AI intentionally kills X children per year" and the regulatory reaction.