convert matrix

value function

in MRP

in MDP

action-value function

in MDP

example

value function

in MRP

in MDP

optimality

value function

action-value function

compare value, action-value function

example

optimality equation

value function

action-value function