I've always thought that normalization, as defined in the statistical sense, needs to be a linear transformation to preserve the shape of the distribution. tanh

I've always thought that normalization, as defined in the statistical sense, needs to be a linear transformation to preserve the shape of the distribution. tanh is definitely not normalization from that point of view. Even so, they could have been more specific and called it 'linear normalization'.