To expand on the other answers, if you want a notion of angle between things then you need the distance to be defined by an inner product (dot product). This le

To expand on the other answers, if you want a notion of angle between things then you need the distance to be defined by an inner product (dot product). This leads to the square. So, in some sense squared error generalized our geometric intuitions the best.