3 ms·
What are the current ppl languages that are pushing the proverbial envelope?
by adamnemecek 10y ago
What are the current ppl languages that are pushing the proverbial envelope?
- tbenst 10y agoAnglican for high performance (Clojure host, strong multithreading support) and WebPPL for ease of integration (JavaScript client side or server side). Both are implemented using continuation passing style trampolines.
- sgt101 10y agoerrm "continuation passing style trampolines"... ???
- tbenst 10y agoYou don't need to know what that is to use the languages :). In essence, functions always take one argument plus a "continuation," which takes the value that would have otherwise returned. This is called a trampoline. It's typically a compilation technique rather than a programming style.
- sgt101 10y agoSounds like a curried function to me.
- deleted 10y ago[deleted]
- tansey 10y agoStan (http://mc-stan.org/documentation/ http://mc-stan.org/documentation/) is arguably the most advanced language. It's especially pushing the bounds of doing automatic variational inference, for the scenario where your model does not have a nice conjugate form that would be amenable to Gibbs sampling. It's not quite reached what I would say is production-quality, but some of the best people in the world of computational Bayesian methods (e.g., Michael Betancourt, most of David Blei's lab, etc.) are working on it.
- tbenst 10y agoYes Stan is awesome! The main difference between something like Stan and "next gen" languages like Anglican and Webppl, is there are basically no restrictions in where you use a distribution. Nested inference, probabilistic recursion, etc are all possible. For certain classes of problems this leads to greatly enhanced expressiveness. On the flip side, Stan is more production ready right now
- jmde 10y agoA major downside of Stan is its lack of support for discrete priors. This isn't really advertised very well, but is more of a problem than it might sound initially. Its type handling also can get a little frustrating at times. Overall, I highly recommend it but it does have its downsides, and there's some room for alternatives or improvement.
- twiecki 10y agoPyMC3 (http://pymc-devs.github.io/pymc3/ http://pymc-devs.github.io/pymc3/) has all the powerful samplers that Stan has (i.e. NUTS) as well as support for discrete priors. It allows you to specify your models in pure Python, supports matrix algebra, and also has variational inference which allows for large-ish scale machine learning (e.g. here is a blog post where I train a Bayesian Neural Net on MNIST http://twiecki.github.io/blog/2016/07/05/bayesian-deep-learning/ http://twiecki.github.io/blog/2016/07/05/bayesian-deep-learn...). Under the hood, it uses theano for JIT compilation to C or GPU. I'm one of the core devs.