* Isn't this outdated retro technology compared to layer normalization?* Yeah, no. Train Resnet-50 with batchnorm, and with layer norm (or weight norm, or gro

* Isn't this outdated retro technology compared to layer normalization?* Yeah, no. Train Resnet-50 with batchnorm, and with layer norm (or weight norm, or group norm), and you will see batchnorm is still the best.