Skip to content

Commit 377c875

Browse files
author
Aerin Kim
committed
added Sutton book's equation
1 parent 07dd722 commit 377c875

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

DP/Value Iteration Solution.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,7 @@
7474
" best_action_value = np.max(A)\n",
7575
" # Calculate delta across all states seen so far\n",
7676
" delta = max(delta, np.abs(best_action_value - V[s]))\n",
77-
" # Update the value function\n",
77+
" # Update the value function. Ref: Sutton book eq. 4.10. \n",
7878
" V[s] = best_action_value \n",
7979
" # Check if we can stop \n",
8080
" if delta < theta:\n",

0 commit comments

Comments
 (0)