3 ms·
I love Julia, but I think comparing Pyro with Turing is pretty unfair. Pyro can scale to pretty big datasets thanks to custom inference via guides. So you can
by nextos 6y ago
I love Julia, but I think comparing Pyro with Turing is pretty unfair.
Pyro can scale to pretty big datasets thanks to custom inference via guides. So you can do inference on pretty sophisticated models such as Deep Markov.
Whereas Turing is mostly for small or medium sized models. For learning purposes, for smaller models or for non-parametrics Turing might be a much better choice, though.
- outlace 6y agoBut isn’t the good scaling due to using variational inference rather than full MCMC? Turing has VI too.
- marmaduke 6y agothe "good scaling" is due to variational inference, which turns inference problems into optimization problems, but one has to verify the variational approximation holds, etc. In my experience, Pyro (generally variational inference) is more like a Bayesian optimization than full inference, since it will simply miss multimodality or non-Gaussian tails, etc.
- nextos 6y agoNot just that. Aside from the fact that Pyro has a lot of guide tooling, you get for example (hybrid) message passing for HMMs. This is crucial to scale beyond toy data. Within Julia, ForneyLab.jl is quite cool for non-deep state space models. I also like Turing.jl, but it has different tradeoffs.
- deleted 6y ago[deleted]
- deleted 6y ago[deleted]