Information loss / maximum likelihood only applies in special case distributions. E.g. take a distribution of variable X and the arithmetic mean might be the ap

Information loss / maximum likelihood only applies in special case distributions. E.g. take a distribution of variable X and the arithmetic mean might be the appropriate average. But then if you look at sqrt(X) then the appropriate average would be RMS.