converting between graphical models
(40 minutes to learn)
Summary
Bayes nets and MRFs are two frameworks for specifying factorization and conditional independence structure in probabilistic models. There are transformations which convert from one graphical model formalism to the other. However, sometimes these transformations must lose precision, because there are sets of independencies which can be represented as Bayes nets but not MRFs, and vice versa.
Context
This concept has the prerequisites:
- Bayesian networks
- d-separation (Reasoning about representational power requires the conditional independence interpretation.)
- Markov random fields
Core resources (read/watch one of the following)
-Free-
→ Coursera: Probabilistic Graphical Models (2013)
An online course on probabilistic graphical models.
Location:
Lecture "I-maps and perfect maps"
Other notes:
- Click on "Preview" to see the videos.
-Paid-
→ Pattern Recognition and Machine Learning
A textbook for a graduate machine learning course, with a focus on Bayesian methods.
Location:
Section 8.3.4, pages 390-393
Supplemental resources (the following are optional, but you may find them useful)
-Paid-
→ Probabilistic Graphical Models: Principles and Techniques
A very comprehensive textbook for a graduate-level course on probabilistic AI.
Location:
Sections 3.2.3 (pages 60-64), Section 3.4-3.4.2 (pages 78-83), and Section 4.5 (pages 134-142)
See also
-No Additional Notes-