To support our site, Class Central may be compensated by some course providers.

Reinforcement Learning

Brown University and Georgia Institute of Technology via Udacity

students interested

Taken this course? Share your experience with other students. Write review

Overview

You should take this course if you have an interest in machine learning and the desire to engage with it from a theoretical perspective. Through a combination of classic papers and more recent work, you will explore automated decision-making from a computer-science perspective. You will examine efficient algorithms, where they exist, for single-agent and multi-agent planning as well as approaches to learning near-optimal decisions from experience. At the end of the course, you will replicate a result from a published paper in reinforcement learning.



Why Take This Course?

This course will prepare you to participate in the reinforcement learning research community. You will also have the opportunity to learn from two of the foremost experts in this field of research, Profs. Charles Isbell and Michael Littman.

Syllabus

  • Reinforcement Learning Basics
  • Introduction to BURLAP
  • TD Lambda
  • Convergence of Value and Policy Iteration
  • Reward Shaping
  • Exploration
  • Generalization
  • Partially Observable MDPs
  • Options
  • Topics in Game Theory
  • Further Topics in RL Models

Taught by

Charles Isbell and Michael Littman

Help Center

Most commonly asked questions about Udacity Udacity

Reviews for Udacity's Reinforcement Learning
2.9 Based on 8 reviews

  • 5 stars 25%
  • 4 stars 25%
  • 3 star 0%
  • 2 star 13%
  • 1 stars 38%

Did you take this course? Share your experience with other students.

Write a review
  • 1
Anonymous
1.0 2 years ago
Anonymous completed this course.
Extremely slow paced, with most of the topics handwaved. I've read Sutton's book. Topics (not all) from the book were covered on a shallow level. Additional topics were explained in such a way that you need to read other resources in order to actually implement them.

There are better books and resources on RL, don't waste time on this course
Was this review helpful to you? Yes
Jason W
4.0 8 months ago
by Jason is taking this course right now, spending 8 hours a week on it and found the course difficulty to be medium.
One of the best course. I have learned since their machine learning course and love the interaction between the lecturer. Some people complained about the slow pace, but there is actually a simplify version of RL in the ML class I've mentioned. Go check it out if you don't have time. This course supposed to go "deep". And believe me, the RL course you might take in the college or grad school is much more "slow paced" than this one.

Pro:

- They let student to think along the way, not just cram the stuffs into our head

- A sense of humor in teaching the class

Con:

- Lack of support on the homework, as well as using framework BURLAP require steep learning curve

- Some context such as TD(0) and TD(1) can be explained more intuitively (maybe it's just me not quite understand that part)
Was this review helpful to you? Yes
Anonymous
5.0 7 months ago
Anonymous is taking this course right now.
I think this course is awesome! The constant interaction between both professors really clarifies concepts and helps to avoid some bias about certain topics. However, as another reviewer, this course is not meant for beginners in the RL domain. I recommend taking Prof. David Silver's free online lectures before this course. I am experimenting that mixture and both courses complement superbly. This course is a more advanced and fast-paced course in RL compared to standard RL literature. At the begging it seems challenging but they encourage you to think about the problem and not just giving you all the solutions. I really recommend this course if you want to do research in RL and then Deep Reinforcement learning fields.
Was this review helpful to you? Yes
Vinayak M
4.0 4 years ago
by Vinayak audited this course, spending 10 hours a week on it and found the course difficulty to be hard.
The way in which the instructors teach is awesome.

This is a masters level machine learning course. I would recommend taking this course at a slow pace if you're a beginner in the machine learning domain, making sure that you get a thorough understanding of the material.
4 people found
this review helpful
Was this review helpful to you? Yes
Soonyau C
1.0 2 years ago
by Soonyau dropped this course, spending 2 hours a week on it and found the course difficulty to be medium.
The pace was extremely slow and there were too much nonsense going on between the two speakers. Just give the equations, explaination, examples and then move on!
Was this review helpful to you? Yes
Anonymous
5.0 2 years ago
Anonymous completed this course.
Not as a first-time Reinforcement Learning course. You will have issues. Take David Silver's available on YouTube first and then come to this one. You'll enjoy it much more that way.
Was this review helpful to you? Yes
Anonymous
1.0 2 years ago
Anonymous is taking this course right now.
Looks very slow and waste of time. Material is not matching with the lectures. Also, need to give codes for offline trials that only doing filups in lectures.
Was this review helpful to you? Yes
Anonymous
2.0 3 years ago
Anonymous partially completed this course.
I am not assessing the whole course cause I couldn't make it through the first week because I didn't like it very much. The pace is very slow and the course doesn't seem to be very thorough. There is lots of redundant chit-chat, analogies and talking that doesn't contribute to better understanding. It's also quite chaotic and unsystematic. Maybe it's a good idea for people that are not very bright and have no knowledge whatsoever on the topic, but otherwise I wouldn't recommend it. (As I mentioned my opinion is based solely on the first chapter - MDPs)
2 people found
this review helpful
Was this review helpful to you? Yes
  • 1

Class Central

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free

Never stop learning Never Stop Learning!

Get personalized course recommendations, track subjects and courses with reminders, and more.