subject
Intro

Coursera: Probabilistic Graphical Models 1: Representation

 with  Daphne Koller
Probabilistic graphical models (PGMs) are a rich framework for encoding probability distributions over complex domains: joint (multivariate) distributions over large numbers of random variables that interact with each other. These representations sit at the intersection of statistics and computer science, relying on concepts from probability theory, graph algorithms, machine learning, and more. They are the basis for the state-of-the-art methods in a wide variety of applications, such as medical diagnosis, image understanding, speech recognition, natural language processing, and many, many more. They are also a foundational tool in formulating many machine learning problems.

This course is the first in a sequence of three. It describes the two basic PGM representations: Bayesian Networks, which rely on a directed graph; and Markov networks, which use an undirected graph. The course discusses both the theoretical properties of these representations as well as their use in practice. The (highly recommended) honors track contains several hands-on assignments on how to represent some real-world problems. The course also presents some important extensions beyond the basic PGM representation, which allow more complex models to be encoded compactly.

Syllabus

Introduction and Overview
This module provides an overall introduction to probabilistic graphical models, and defines a few of the key concepts that will be used later in the course.

Bayesian Network (Directed Models)
In this module, we define the Bayesian network representation and its semantics. We also analyze the relationship between the graph structure and the independence properties of a distribution represented over that graph. Finally, we give some practical tips on how to model a real-world situation as a Bayesian network.

Template Models for Bayesian Networks
In many cases, we need to model distributions that have a recurring structure. In this module, we describe representations for two such situations. One is temporal scenarios, where we want to model a probabilistic structure that holds constant over time; here, we use Hidden Markov Models, or, more generally, Dynamic Bayesian Networks. The other is aimed at scenarios that involve multiple similar entities, each of whose properties is governed by a similar model; here, we use Plate Models.

Structured CPDs for Bayesian Networks
A table-based representation of a CPD in a Bayesian network has a size that grows exponentially in the number of parents. There are a variety of other form of CPD that exploit some type of structure in the dependency model to allow for a much more compact representation. Here we describe a number of the ones most commonly used in practice.

Markov Networks (Undirected Models)
In this module, we describe Markov networks (also called Markov random fields): probabilistic graphical models based on an undirected graph representation. We discuss the representation of these models and their semantics. We also analyze the independence properties of distributions encoded by these graphs, and their relationship to the graph structure. We compare these independencies to those encoded by a Bayesian network, giving us some insight on which type of model is more suitable for which scenarios.

Decision Making
In this module, we discuss the task of decision making under uncertainty. We describe the framework of decision theory, including some aspects of utility functions. We then talk about how decision making scenarios can be encoded as a graphical model called an Influence Diagram, and how such models provide insight both into decision making and the value of information gathering.

Knowledge Engineering & Summary
This module provides an overview of graphical model representations and some of the real-world considerations when modeling a scenario as a graphical model. It also includes the course final exam.

17 Student
reviews
Cost Free Online Course (Audit)
Pace Upcoming
Institution Stanford University
Provider Coursera
Language English
Certificates Paid Certificate Available
Hours 15-20 hours a week
Calendar 5 weeks long
Sign up for free? Learn how

Disclosure: To support our site, Class Central may be compensated by some course providers.

+ Add to My Courses
FAQ View All
What are MOOCs?
MOOCs stand for Massive Open Online Courses. These are free online courses from universities around the world (eg. Stanford Harvard MIT) offered to anyone with an internet connection.
How do I register?
To register for a course, click on "Go to Class" button on the course page. This will take you to the providers website where you can register for the course.
How do these MOOCs or free online courses work?
MOOCs are designed for an online audience, teaching primarily through short (5-20 min.) pre recorded video lectures, that you watch on weekly schedule when convenient for you.  They also have student discussion forums, homework/assignments, and online quizzes or exams.

17 reviews for Coursera's Probabilistic Graphical Models 1: Representation

Write a review
7 out of 8 people found the following review useful
3 years ago
profile picture
Krassimir Kostadinov completed this course.
Excellent lecturer who explains clearly pretty complex notions through carefully selected examples. Presented are many links to real-world applications. Unlike other courses on coursera, this one is not 'watered down'. The course claims that 'the average Stanford student needs between 15 and 20 hours of work per week Read More
Excellent lecturer who explains clearly pretty complex notions through carefully selected examples. Presented are many links to real-world applications. Unlike other courses on coursera, this one is not 'watered down'.

The course claims that 'the average Stanford student needs between 15 and 20 hours of work per week to complete the course'. This might be true for some students. In my personal experience this statement was exaggerated, but nevertheless I needed about 7h/week (60% of which was spend on the programming assignments for the advanced track). For a working professional this might be too much.
Was this review helpful to you? YES | NO
5 out of 6 people found the following review useful
5 years ago
profile picture
Anonymous completed this course.
This class was interesting and it was very difficult. The problem was, it was difficult for all the wrong reasons. I could spend days trying to get the grading system to accept my programming assignment all to find out that I was missing an assumption that wasn't stated anywhere in the assignment write-up or the lectur Read More
This class was interesting and it was very difficult. The problem was, it was difficult for all the wrong reasons. I could spend days trying to get the grading system to accept my programming assignment all to find out that I was missing an assumption that wasn't stated anywhere in the assignment write-up or the lecture videos. Sometimes you'd get lucky and somebody in the forums would figure out what the gotcha was early on.
Was this review helpful to you? YES | NO
1 out of 1 people found the following review useful
a year ago
profile picture
Anonymous completed this course.
The course is interesting though hard, but lack the great pedagogy of Andrew Ng in his "Machine Learning Course". - The syllabus logic is weird. - It is a lot about theory and lack connection with concrete examples with some data and code - When there are examples, they are often badly connected to the topic of the Read More
The course is interesting though hard, but lack the great pedagogy of Andrew Ng in his "Machine Learning Course".

- The syllabus logic is weird.

- It is a lot about theory and lack connection with concrete examples with some data and code

- When there are examples, they are often badly connected to the topic of the course, very confusing and/or very poorly explained (you basically need to know what she's trying to explain to understand the example when this example was meant to help you understand a concept!). (ex: the CRF model for OCR or the numerous mentions or a "super pixels" never defined and you don't know wether the model is meant to find good super pixel or if there are taken for granted as inputs to solve the larger question of the classification of the image)

- Moreover, there is a lack of connection to concrete examples with some code.

- Last, the coding assignments are a pain for all the bad reasons, as a previous commenters wrote. It take you ages to figure out what they have written because it's poorly described and lack test cases to help you figuring out!

I recommend this course to be improved by Daphne K. before you take it.
Was this review helpful to you? YES | NO
2 out of 2 people found the following review useful
3 years ago
Kiran Karkera completed this course, spending 20 hours a week on it and found the course difficulty to be very hard.
I found the programming assignments to be quite tough, or put differently, more difficult than any other Coursera course. If not for the generous help of other students in the forum, (a view echoed by many other students), it would be impossible to get through the assignments. In my case, I had to sometimes grind throu Read More
I found the programming assignments to be quite tough, or put differently, more difficult than any other Coursera course. If not for the generous help of other students in the forum, (a view echoed by many other students), it would be impossible to get through the assignments. In my case, I had to sometimes grind through the assignment to finish it in time, sometimes missing the intuition behind a method that was used in the assignment.
Was this review helpful to you? YES | NO
2 out of 2 people found the following review useful
a year ago
profile picture
Anonymous partially completed this course.
she's gotta nice voice very easy to listen to

good material too little over dressed

certainly a topic that one doesn't consider while computing,

but is very necessary in a number of applications within an

application
Was this review helpful to you? YES | NO
2 out of 2 people found the following review useful
a year ago
profile picture
Anonymous completed this course.
This course has been retired since old platform discontinued June 2016 . There seems little hope of it appearing on new platform which is a shame . The course paralleled a real Stanford graduate course
Was this review helpful to you? YES | NO
2 out of 2 people found the following review useful
2 years ago
Dolly Ye is taking this course right now, spending 13 hours a week on it and found the course difficulty to be hard.
She conveys hard stuff in a very lucid manner. One can learn so much about the application of probabilistic models.I love the class!

Was this review helpful to you? YES | NO
11 months ago
Dmytro Aleksandrov completed this course, spending 20 hours a week on it and found the course difficulty to be hard.
Immersing and challenging course. Advises lots of ways for further study in the field. Definitely, choose an advanced track with programming assignments. 20 hours per week - it's true, but no quite correct: not every week material is equally complex, I'd say 20 hours is a peak load. Just try to go at least one week ahe Read More
Immersing and challenging course. Advises lots of ways for further study in the field. Definitely, choose an advanced track with programming assignments. 20 hours per week - it's true, but no quite correct: not every week material is equally complex, I'd say 20 hours is a peak load. Just try to go at least one week ahead of the deadline schedule and you'll be fine. The choice of a Matlab/Octave may seem a bit archaic nowadays. I wish this course was accompanied with assignments in Python or R or Scala.
Was this review helpful to you? YES | NO
10 months ago
profile picture
Anonymous dropped this course.
A very disappointing experience based on following:

1. Audio quality is extremely poor and made worse by the very high (almost painful) fluctuations in the teacher's pitch;

2. Many portions of the audio were intelligible;

3. This was not designed to be a MOOC but slapped together from live lectures.
Was this review helpful to you? YES | NO
0 out of 2 people found the following review useful
4 years ago
profile picture
Marta completed this course, spending 10 hours a week on it and found the course difficulty to be very hard.
Was this review helpful to you? YES | NO
0 out of 1 people found the following review useful
3 years ago
Rey Raul Coaguila completed this course.
Was this review helpful to you? YES | NO
0 out of 1 people found the following review useful
2 years ago
Colin Khein completed this course.
Was this review helpful to you? YES | NO
a year ago
profile picture
Stephane Mysona completed this course.
Was this review helpful to you? YES | NO
7 months ago
profile picture
Sha Liu completed this course.
Was this review helpful to you? YES | NO
a year ago
Tianpei Xie audited this course.
Was this review helpful to you? YES | NO
a year ago
Juliano Ignacio audited this course.
Was this review helpful to you? YES | NO
8 months ago
Amin Abouee partially completed this course.
Was this review helpful to you? YES | NO

Class Central

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free