3 ms·
I just briefly skimmed through parts of it. If I understand the paper correctly, the objective function is a combination of a classifier and a generative model
by jostmey 11y ago
I just briefly skimmed through parts of it.
If I understand the paper correctly, the objective function is a combination of a classifier and a generative model. It sounds a lot like pre-training a neural network as a generative model before fine tuning it as a classifier, except this time the two steps are jammed together. I'm not sure what the benefit would be...
- themann9 11y agoThe benefit seems to be shown on the right chart of Fig 8 (bottom line is best descriptor of probability density). Combining classifiers and generative nets is the natural next step, LeCun is working on in in the context of ConvNets - see their SWWAE paper a few weeks ago
- deepnet 11y agoStacked What-Where Auto-encoders Junbo Zhao, Michael Mathieu, Ross Goroshin, Yann Lecun http://arxiv.org/abs/1506.02351 http://arxiv.org/abs/1506.02351