Course Schedule

Weekday Regular Schedule

Group	Type	Hours	Location
All	Lecture	Sunday 12:00-15:00	Lev auditorium
1	Recitation	Sunday 15:00-16:00	Orenstein 111
2	Recitation	Sunday 16:00-17:00	Orenstein 111

Detailed Schedule

Lecture	Date	Topics	Lecture Slides	Recitation Slides	Comments
1	20/2/2022	Introduction	lecture 1 scribe 1	Pytorch recitation 1
2	27/2/2022	Deterministic Decision Processes: Finite Horizon and Average cost	lecture 2 scribe 2-5	recitation 2	(extra) exercises
3	6/3/2022	Markov Chains and Markov Decision Processes: Finite Horizon	lecture 3 scribe 2-5	recitation 3
4	13/3/2022	MDP: discounted infinite horizon	lecture 4 scribe 2-5	recitation 4 slides	(extra) exercises
5	20/3/2022	Model based learning: off-policy, on-policy, Rmax	lecture 5 scribe 2-5	recitation 5 slides
6	27/3/2022	Model free learning: Q-learning, SARSA, Monte-Carlo	lecture 6 scribe 6	recitation 6
7	3/4/2022	Model free learning: TD(0), TD(lambda), Importance Sampling, Action-Critic	lecture 7 scribe 7	recitation 7
8	24/4/2022	Value Function Approximation	lecture 8 scribe 8	recitation 8
9	1/5/2022	Policy Gradient	lecture 9 scribe 9	recitation 9 code
10	8/5/2022	Stochastic Multi-Arm Bandits	lecture 10 scribe 10	recitation 10
11	15/5/2022	Partially Observable MDP (POMDP)	lecture 11 scribe 11	recitation 11
12	22/5/2022	Linear Dynamics models (LQR)	lecture 12 scribe 12	recitation 12
13	29/5/2022	Generative model; Inverse RL	lecture 13 scribe 13	recitation 13