exercise added

Author: sant_si

bag_of_words.ipynb

@@ -394,6 +394,15 @@
     "foo = \"My baby and all other babies in my buildings are crying laughing and playing all the time\""
    ]
   },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "from nltk import word_tokenize"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -473,6 +482,15 @@
     "eggs = '''Phew! After lots of <br>, I finally cleared all these \"English\" and \"Science\" exams'''"
    ]
   },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "string.punctuation"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -482,6 +500,15 @@
     "punctuation_map = str.maketrans('', '', string.punctuation)"
    ]
   },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "str.maketrans?"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -491,6 +518,25 @@
     "eggs.translate(punctuation_map)"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "!Exercise\n",
+    "\n",
+    "Try to apply all that we have learnt with the following paragraph. Tokenize the sentences, words, Remove punctuations, Apply stemming or lemmatization."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "foobar = '''With a key sentence established, the next task is to shape the body of your paragraph to be both cohesive and coherent. As Williams and Bizup[3] explain, cohesion is about the “sense of flow” (how each sentence fits with the next), while coherence is about the “sense of the whole.”[4]\n",
+    "To reiterate the initial point, it is useful to think of paragraphs as punctuation that organize your ideas in a readable way. Each paragraph should be an irreplaceable node within a coherent sequence of logic. Thinking of paragraphs as “building blocks” evokes the “five-paragraph theme” structure explained earlier: if you have identical stone blocks, it hardly matters what order they’re in.'''"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,