3 ms·
You can do basic math to a multivariate normal distribution to approximate other distributions. In classic feedforward networks, that's achieved by using nonlin
by yorwba 7y ago
You can do basic math to a multivariate normal distribution to approximate other distributions. In classic feedforward networks, that's achieved by using nonlinear activation functions. Very wide networks turn into Gaussian processes in the limit [0]. There are also approaches explicitly embracing the "basic math on multivariate normal distributions" framework using normalizing flows [1].
[0] https://arxiv.org/abs/1711.00165 https://arxiv.org/abs/1711.00165
[1] https://arxiv.org/abs/1505.05770 https://arxiv.org/abs/1505.05770
- jahewson 7y agoI feel like this is kinda cheating though - “Gaussian in the limit” is not the same as “Gaussian”.