Course Schedule

Weekday Regular Schedule

Group Type Hours Location
All Lecture Wednesday 10:00-13:00 Dan David 001
1 Recitation Wednesday 14:00-15:00 Orenshtein 110
2 Recitation Wednesday 15:00-16:00 Orenshtein 110

Detailed Schedule

Lecture Date Topics Lecture Slides Recitation Slides Comments
1 7/3/2018 Introduction lecture 1 scribe 1 recitation 1
2 14/3/2018 Deterministic Decision Processes: Finite Horizon and Average cost lecture 2 scribe 2 recitation 2 exercises
3 21/3/2018 Markov Chains and Markov Decision Processes: Finite Horizon lecture 3 scribe 3 recitation 3
4 26/3/2018 MDP: discounted infinite horizon lecture 4 scribe 4 recitation 4 exercises
5 11/4/2018 Model based learning: off-policy, on-policy, Rmax lecture 5 scribe 5 recitation 5
6 25/4/2018 Model free learning: Q-learning, SARSA, Monte-Carlo lecture 6 scribe 6 recitation 6
7 2/5/2018 Model free learning: TD(0), TD(lambda), Importance Sampling, Action-Critic lecture 7 scribe 7 recitation 7
8 9/5/2018 Value Function Approximation lecture 8 scribe 8 recitation 8
9 16/5/2018 Policy Gradient lecture 9 scribe 9 recitation 9 code
10 23/5/2018 Stochastic Multi-Arm Bandits lecture 10 scribe 10 recitation 10
11 30/5/2018 Partially Observable MDP (POMDP) lecture 11 scribe 11 recitation 11
12 6/6/2018 Linear Dynamics models (LQR) lecture 12 scribe 12 recitation 12
13 13/6/2018 Generative model; Inverse RL lecture 13 scribe 13 recitation 13
Unless otherwise stated, the content of this page is licensed under Creative Commons Attribution-ShareAlike 3.0 License