## Materials
* [__Lecture slides__](https://docs.google.com/presentation/d/1dyTsV4MfLb006VHMQvrMTEvSMjsN4B4ymoiWl-HrqVs)
* Our videos: [lecture](https://yadi.sk/i/qsYgN53mviDpQw) [seminar](https://yadi.sk/i/umiVNsMWngtodg) (russian)
* __[main]__ lecture by David Silver - [url](https://www.youtube.com/watch?v=Nd1-UUMVfz4)
* Alternative lecture by Pieter Abbeel (english): [part 1](https://www.youtube.com/watch?v=i0o-ui1N35U), [part 2](https://www.youtube.com/watch?v=Csiiv6WGzKM)
* Alternative lecture by John Schulmann (english): [video](https://www.youtube.com/watch?v=IL3gVyJMmhg)
* Definitive guide in policy/value iteration from Sutton: start from page 81 [here](http://incompleteideas.net/book/the-book-2nd.html).


## Homework description:

The main assignment is `seminar_vi.ipynb`[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/yandexdataschool/Practical_RL/blob/master/week02_value_based/seminar_vi.ipynb) notebook in this week's folder. It has no requirements besides the most basic data science libraries (e.g. numpy) so you should be able to run it locally.

__Note:__ if you have any difficulty using graphviz, just set `has_graphviz=False`.
