4 ms·
But isn’t the good scaling due to using variational inference rather than full MCMC? Turing has VI too.
by outlace 6y ago
But isn’t the good scaling due to using variational inference rather than full MCMC? Turing has VI too.
- marmaduke 6y agothe "good scaling" is due to variational inference, which turns inference problems into optimization problems, but one has to verify the variational approximation holds, etc. In my experience, Pyro (generally variational inference) is more like a Bayesian optimization than full inference, since it will simply miss multimodality or non-Gaussian tails, etc.
- nextos 6y agoNot just that. Aside from the fact that Pyro has a lot of guide tooling, you get for example (hybrid) message passing for HMMs. This is crucial to scale beyond toy data. Within Julia, ForneyLab.jl is quite cool for non-deep state space models. I also like Turing.jl, but it has different tradeoffs.
- deleted 6y ago[deleted]
- deleted 6y ago[deleted]