> As AI begins to be applied to problems like driving that affect the real world instead of just information, I’d add: > Ethical use of AI should not create neg

> As AI begins to be applied to problems like driving that affect the real world instead of just information, I’d add: > Ethical use of AI should not create negative externalities - negative impacts on people other than those making the choice to use it. I’d go one step further and say that ethical AI should not create any negative externalities to humans period -- not even those that choose to use it. An example that can be informative here is different than the traditional AI-driving “trolley problem” (i.e. do nothing and kill five people on the crosswalk, or swerve and kill only the passenger), it relates to a more subtle, quotidien challenge faced in autonomous cars: what happens to backseat driving? How will a car that is driven by an AI treat its passengers ethically and insure that it never does them any harm? Even a minor discomfort because, say, an acceleration pattern made them uncomfortable, is an ethical issue if the human has no recourse or if there is systematic prioritization of other goals over the human’s. One solution is to make cars sensitive to humans’ feelings while they’re being driven, so that the car’s brain has an awareness that, within the right framework, lets it continuously adjust its behavior to serve its passengers better. Essentially, the aim is to make the car empathic, artificially giving it the type of human intuition that can help avoid unintended outcomes big or small. The more that AI systems in general can be sensitive to our human experience, the better I believe. It is very hard, pragmatically speaking, to always balance the need for easy/cheap AND safe solutions in the real-world. Clearly defined goals and non-goals as well as intermediate steps for measuring against them at least seem to be a good start, since these provide the framework that lets fast feedback mechanisms guide AI to evolve in a way that’s coupled directly with human interest.