> Pilots have to be specifically taught to trust their instruments over themselves. There is a difference between metrics and automation. In this case, they ar

> Pilots have to be specifically taught to trust their instruments over themselves. There is a difference between metrics and automation. In this case, they are trusting metrics, not automation. > But why should we distrust automation? I can name one off the top of my head: exceptions. Automation sucks at exceptions. Either nobody thought of it or it is ignored and ends up screwing everyone. Take my credit history in the US as an example. In my late teens, I got into an accident and couldn't work. I couldn't pay my bills. Within a few months, I was back on my feet; but it took nearly 10 years to get my credit score to something somewhat reasonable. I had employers look at my credit history and go "nope" because the machine said I wasn't trust-worthy. Should you trust the automation? Probably never, unless it knows how to deal with exceptions.