Just by going off the wikipedia page, this seems like a really hairy problem because of the definition We'd expect some kind of AI-human parity in avoiding obs

Just by going off the wikipedia page, this seems like a really hairy problem because of the definition We'd expect some kind of AI-human parity in avoiding obstacles while driving in common sense speak as "don't hit that, or you'll have a wreck", but we don't really expect the car AI to see a bad collision between two other cars on a perpendicular road and call emergency services (as should be common sense for humans). But if the cars involved in that collision have a detection system to automatically call 911 (any kind of OnStar variant), why should an AI concern itself with that knowing there is a system to handle that task? Would it be common sense for the AI to act as a parallel system and make sure the primary didn't fail to call 911? A human's common sense might be to act as if that system didn't exist because it might have failed and just call anyway (knowing that there's really no penalty for calling twice just to make sure)