Skip to content

Commit 9771e6a

Browse files
committed
update
1 parent a3f4edf commit 9771e6a

File tree

2 files changed

+62
-20
lines changed

2 files changed

+62
-20
lines changed

doc/pub/week7/ipynb/rnncode.ipynb

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -893,7 +893,7 @@
893893
"cell_type": "markdown",
894894
"metadata": {},
895895
"source": [
896-
"We also want to be able to choose which method we want to use for gradient descent when training the RNN. This is done by using a scheduler defined below. These schedulers are identical to the ones used in FYS-STK4155."
896+
"We also want to be able to choose which method we want to use for gradient descent when training the RNN. This is done by using a scheduler defined below. These schedulers are identical to the ones used in FYS-STK4155 and during our discussions of the CNN code, see codes from week 5."
897897
]
898898
},
899899
{
@@ -1136,10 +1136,10 @@
11361136
"\n",
11371137
"<u>**Note:**</u> The input and output from a node are two-dimensional arrays, with different inputs along the first axis, and the features along the second axis. The equations we have derived for computing forward- and backpropagation assume that we are working with column vectors, but when performing matrix multiplication with these two-dimensional arrays we are in practice working with row vectors. This has to be taken into account in our code.\n",
11381138
"\n",
1139-
"Consider, for instance, multiplying some weight matrix $W$ with a vector $\\mathbf{h}$. The way we have derived the equations this will look like\n",
1139+
"Consider, for instance, multiplying some weight matrix $\\mathbf{W}$ with a vector $\\mathbf{h}$. The way we have derived the equations this will look like\n",
11401140
"\n",
11411141
"$$\n",
1142-
"W\\mathbf{h} = \\begin{pmatrix}\n",
1142+
"\\mathbf{Wh} = \\begin{pmatrix}\n",
11431143
"W_{11} & \\cdots & W_{1n}\\\\\n",
11441144
"\\vdots & \\ddots & \\vdots\\\\\n",
11451145
"W_{m1} & \\cdots & W_{mn}\n",

0 commit comments

Comments
 (0)