⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’

Excalidraw Data

Text Elements

Chapter 01 Basic Concepts

Chapter 02 Bellman Equation

Chapter 03 Bellman Optimality Equation

Fundamental tools

Chapter 04 Value Iteration & Policy Iteration

Chapter 05 Monte Carlo Methods

Chapter 07 Temporal-Difference Methods

Chapter 06 Stochastic Approximation

Chapter 08 Value Function Methods

Chapter 09 Policy Gradient Methods

Chapter 10 Actor-Critic Methods

model-based to model-free

non-incremental to incremental

tabular to function

value-based to policy-based

policy-based plus value-based

RM methods

Algorithms/Methods