3 ms·
My mentor was very very adamant about Bayesian network and hierarchical as being deep learning. He sees the latent layer in the hierarchical model as the hidde
by digitalzombie 8y ago
My mentor was very very adamant about Bayesian network and hierarchical as being deep learning.
He sees the latent layer in the hierarchical model as the hidden layer and the Bayesian just have a strict restrictions/assumptions to the network where as the deep learning is more dumb and less assuming. A few of my professor thinks that PGM, probability graphical model is a super set of deep learning/neural network.
This is where my thinking come from.
IIRC, a paper have shown that gradient descent seems to exhibit MCMCs (blog with paper link inside that led to this conclusion of mine: http://www.inference.vc/everything-that-works-works-because-its-bayesian-2/ http://www.inference.vc/everything-that-works-works-because-...).
But I am not an expert in Neural Network nor know the topic well enough to say such a thing. Other than was deferring to opinions of some one that's better than myself. So I'll keep this in mind and hopefully one day have the time to do more research into this topic.
Thank you.
- eli_gottlieb 8y agoI think your link, and your mentor, are somewhat fundamentalist about their Bayesianism.