From 9e69b1691149cd442ec83ae177f242ff00721330 Mon Sep 17 00:00:00 2001 From: Rubens Date: Wed, 11 Mar 2020 16:03:15 -0300 Subject: [PATCH] chapter 12 typo errors --- 12_nlp_dive.ipynb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/12_nlp_dive.ipynb b/12_nlp_dive.ipynb index 070cc83..95a9561 100644 --- a/12_nlp_dive.ipynb +++ b/12_nlp_dive.ipynb @@ -1568,7 +1568,7 @@ "cell_type": "markdown", "metadata": {}, "source": [ - "In this picture, our input $x_{t}$ enters on the bottom with the previous hidden state ($h_{t-1}$) and cell state ($x_{t-1}$). The four orange boxes represent four layers with the activation being either sigmoid (for $\\sigma$) or tanh. tanh is just a sigmoid rescaled to the range -1 to 1. Its mathematical expression can be written like this:\n", + "In this picture, our input $x_{t}$ enters on the bottom with the previous hidden state ($h_{t-1}$) and cell state ($c_{t-1}$). The four orange boxes represent four layers with the activation being either sigmoid (for $\\sigma$) or tanh. tanh is just a sigmoid rescaled to the range -1 to 1. Its mathematical expression can be written like this:\n", "\n", "$$\\tanh(x) = \\frac{e^{x} + e^{-x}}{e^{x}-e^{-x}} = 2 \\sigma(2x) - 1$$\n", "\n",