5 ms·

> Probabilistic Graphical Models, Daphne Koller – the first course in the specialization has a very good and engaging start, but the gap between lectures and p

> Probabilistic Graphical Models, Daphne Koller – the first course in the specialization has a very good and engaging start, but the gap between lectures and problems widens quickly after that (maybe that's why the author boasts about a "challenging" course "not for everyone"). I'm hesitant to take the next course of the specialization.

sampo 9y ago
I wrote about the first version when it was all in one course. It seems they have split it into 3 courses now. Probably it's less dense now.
- Rosinante 9y ago
  I too took the first iteration, and it was... quite terrible. The lectures were OK, but the homework was more than challenging. Not only had you to battle with the topic itself, but then you need to magically acquire knowledge in some totally unknown topic (I think it was genetics) and wrangle the quite baroque representation of that topic shoehorned in a programming language that is totally not made for it. I was on the verge of despair because of those secondary problems. Really.
bitL 9y ago
PGM was brutal... At Stanford straight As students were happy just to pass...
- dmytrish 9y ago
  It's indeed dense and packed with many intermediate intuitions. On the other hand, I still feel that the course is often unnecessarily brutal and could use better explanations.
  - bitL 9y ago
    MIT had a similar course on edX and that one was brutal as well (Computational Probability and Inference). I guess nobody figured out how to teach it the easy way.
- diab0lic 9y ago
  I've been meaning to either take the course or read the book. I'm curious if you've read the book [0] and how you would compare or if you'd recommend one, the other or both. [0] https://mitpress.mit.edu/books/probabilistic-graphical-models https://mitpress.mit.edu/books/probabilistic-graphical-model...
  - imh 9y ago
    I read the book nearly cover to cover. I can't recommend it enough, but it's an enormous time and energy investment.
    - diab0lic 9y ago
      Thanks for the response friend, I think I'll order myself a copy soon and get working on that enormous time and energy investment. :D
mr_overalls 9y ago
Is PGM still relevant as it was five years ago, given the renaissance in deep learning and other NN techniques?
- matiasz 9y ago
  Yes [1]. [1] https://arxiv.org/abs/1801.04016 https://arxiv.org/abs/1801.04016
- plafl 9y ago
  For me Bayesian networks are a tool of thought and I think it's worthy to learn them in the same way it's worthy to learn to sketch functions with pen and paper.
- swframe2 9y ago
  Checkout http://edwardlib.org/ http://edwardlib.org/ and https://www.tensorflow.org/api_docs/python/tf/contrib/bayesflow https://www.tensorflow.org/api_docs/python/tf/contrib/bayesf.... Also Bayesian Methods for Hackers: https://news.ycombinator.com/item?id=16482421 https://news.ycombinator.com/item?id=16482421
- ansible 9y ago
  Yes, I think so. PGM or some improvement on that is relevant to doing things like reasoning correctly based on evidence. I envision more sophisticated AGI systems to use DNN or other NN techniques to learn about the world, and be able to take in uncertain input and make sense of it. PGM or similar would then be used to correctly (in the mathematical sense) reason about what to do to accomplish the agent's goals.
- parsthis 9y ago
  Also graphical models are combined with deep learning techniques for SOTA performance in area like Named Entity Recognition.
swframe2 9y ago
FYI: This video on PGM by Bert Huang is pretty easy to follow: https://www.youtube.com/watch?v=zCWRTKnOYYg&index=20&list=PLUenpfvlyoa0rMoE5nXA8kdctBKE9eSob https://www.youtube.com/watch?v=zCWRTKnOYYg&index=20&list=PL...

sampo 9y ago

I wrote about the first version when it was all in one course. It seems they have split it into 3 courses now. Probably it's less dense now.

Rosinante 9y ago
I too took the first iteration, and it was... quite terrible. The lectures were OK, but the homework was more than challenging. Not only had you to battle with the topic itself, but then you need to magically acquire knowledge in some totally unknown topic (I think it was genetics) and wrangle the quite baroque representation of that topic shoehorned in a programming language that is totally not made for it. I was on the verge of despair because of those secondary problems. Really.

bitL 9y ago

PGM was brutal... At Stanford straight As students were happy just to pass...

dmytrish 9y ago
It's indeed dense and packed with many intermediate intuitions. On the other hand, I still feel that the course is often unnecessarily brutal and could use better explanations.
- bitL 9y ago
  MIT had a similar course on edX and that one was brutal as well (Computational Probability and Inference). I guess nobody figured out how to teach it the easy way.
diab0lic 9y ago
I've been meaning to either take the course or read the book. I'm curious if you've read the book [0] and how you would compare or if you'd recommend one, the other or both. [0] https://mitpress.mit.edu/books/probabilistic-graphical-models https://mitpress.mit.edu/books/probabilistic-graphical-model...
- imh 9y ago
  I read the book nearly cover to cover. I can't recommend it enough, but it's an enormous time and energy investment.
  - diab0lic 9y ago
    Thanks for the response friend, I think I'll order myself a copy soon and get working on that enormous time and energy investment. :D

mr_overalls 9y ago

Is PGM still relevant as it was five years ago, given the renaissance in deep learning and other NN techniques?

matiasz 9y ago
Yes [1]. [1] https://arxiv.org/abs/1801.04016 https://arxiv.org/abs/1801.04016
plafl 9y ago
For me Bayesian networks are a tool of thought and I think it's worthy to learn them in the same way it's worthy to learn to sketch functions with pen and paper.
swframe2 9y ago
Checkout http://edwardlib.org/ http://edwardlib.org/ and https://www.tensorflow.org/api_docs/python/tf/contrib/bayesflow https://www.tensorflow.org/api_docs/python/tf/contrib/bayesf.... Also Bayesian Methods for Hackers: https://news.ycombinator.com/item?id=16482421 https://news.ycombinator.com/item?id=16482421
ansible 9y ago
Yes, I think so. PGM or some improvement on that is relevant to doing things like reasoning correctly based on evidence. I envision more sophisticated AGI systems to use DNN or other NN techniques to learn about the world, and be able to take in uncertain input and make sense of it. PGM or similar would then be used to correctly (in the mathematical sense) reason about what to do to accomplish the agent's goals.
parsthis 9y ago
Also graphical models are combined with deep learning techniques for SOTA performance in area like Named Entity Recognition.

swframe2 9y ago

FYI: This video on PGM by Bert Huang is pretty easy to follow: https://www.youtube.com/watch?v=zCWRTKnOYYg&index=20&list=PLUenpfvlyoa0rMoE5nXA8kdctBKE9eSob https://www.youtube.com/watch?v=zCWRTKnOYYg&index=20&list=PL...