2 ms·
None of the convnets are Gaussian. It was one of the big reasons convnets came to be at all, to model highly kurtotic distributions like natural images. Chines
by toxik 7y ago
None of the convnets are Gaussian. It was one of the big reasons convnets came to be at all, to model highly kurtotic distributions like natural images.
Chinese convnet research is absolutely state of the art already, indeed.
- yorwba 7y agoYou can do basic math to a multivariate normal distribution to approximate other distributions. In classic feedforward networks, that's achieved by using nonlinear activation functions. Very wide networks turn into Gaussian processes in the limit [0]. There are also approaches explicitly embracing the "basic math on multivariate normal distributions" framework using normalizing flows [1]. [0] https://arxiv.org/abs/1711.00165 https://arxiv.org/abs/1711.00165 [1] https://arxiv.org/abs/1505.05770 https://arxiv.org/abs/1505.05770
- jahewson 7y agoI feel like this is kinda cheating though - “Gaussian in the limit” is not the same as “Gaussian”.