Update description of env.P[s][a]

env.P[s][a] is not a tuple but rather a list of tuples (as probability in that tuple wouldn't make sense otherwise).

Author: sstarzycki

DP/Policy Evaluation.ipynb

@@ -41,7 +41,7 @@
     "    Args:\n",
     "        policy: [S, A] shaped matrix representing the policy.\n",
     "        env: OpenAI env. env.P represents the transition probabilities of the environment.\n",
-    "            env.P[s][a] is a (prob, next_state, reward, done) tuple.\n",
+    "            env.P[s][a] is a list of transition tuples (prob, next_state, reward, done).\n",
     "        theta: We stop evaluation once our value function change is less than theta for all states.\n",
     "        discount_factor: gamma discount factor.\n",
     "    \n",