07. Recurrent Neural Networks/02. Long Short Term Memory - MXNet.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Long Short Term Memory - MXNet (From_Scratch).ipynb",
      "version": "0.3.2",
      "provenance": [],
      "collapsed_sections": []
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "code",
      "metadata": {
        "id": "kPljrJ7Fkxoh",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "import mxnet as mx\n",
        "from mxnet import nd, autograd\n",
        "\n",
        "ctx = mx.gpu()"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "DK1pMOcRlVgE",
        "colab_type": "text"
      },
      "source": [
        "##Reading the data from text file"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "5aBCNwVSlYpT",
        "colab_type": "code",
        "outputId": "10f05ee4-9afa-4151-c1ca-ab4d5d321b64",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 289
        }
      },
      "source": [
        "with open('text.txt') as file:\n",
        "    text = file.read()\n",
        "\n",
        "print(text)"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Artificial intelligence (AI) is the simulation of human intelligence processes by machines, especially computer systems. These processes include learning (the acquisition of information and rules for using the information), reasoning (using rules to reach approximate or definite conclusions) and self-correction.\n",
            "Particular applications of AI include expert systems, speech recognition and machine vision. Artificial intelligence (AI), the ability of a digital computer or computer-controlled robot to perform tasks commonly associated with intelligent beings. The term is frequently applied to the project of developing systems endowed with the intellectual processes characteristic of humans, such as the ability to reason, discover meaning, generalize, or learn from past experience. Since the development of the digital computer in the 1940s, it has been demonstrated that computers can be programmed to carry out very complex tasks—as, for example, discovering proofs for mathematical theorems or playing chess—with great proficiency.\n",
            "Still, despite continuing advances in computer processing speed and memory capacity, there are as yet no programs that can match human flexibility over wider domains or in tasks requiring much everyday knowledge. On the other hand, some programs have attained the performance levels of human experts and professionals in performing certain specific tasks, so that artificial intelligence in this limited sense is found in applications as diverse as medical diagnosis, computer search engines, and voice or handwriting recognition.\n",
            "All but the simplest human behaviour is ascribed to intelligence, while even the most complicated insect behaviour is never taken as an indication of intelligence. What is the difference? Consider the behaviour of the digger wasp, Sphex ichneumoneus. When the female wasp returns to her burrow with food, she first deposits it on the threshold, checks for intruders inside her burrow, and only then, if the coast is clear, carries her food inside. The real nature of the wasp’s instinctual behaviour is revealed if the food is moved a few inches away from the entrance to her burrow while she is inside: on emerging, she will repeat the whole procedure as often as the food is displaced. Intelligence—conspicuously absent in the case of Sphex—must include the ability to adapt to new circumstances.\n",
            "Psychologists generally do not characterize human intelligence by just one trait but by the combination of many diverse abilities. Research in AI has focused chiefly on the following components of intelligence: learning, reasoning, problem solving, perception, and using language.\n",
            "AI can be categorized as either weak or strong. Weak AI, also known as narrow AI, is an AI system that is designed and trained for a particular task. Virtual personal assistants, such as Apple's Siri, are a form of weak AI. Strong AI, also known as artificial general intelligence, is an AI system with generalized human cognitive abilities. When presented with an unfamiliar task, a strong AI system is able to find a solution without human intervention.\n",
            "Because hardware, software and staffing costs for AI can be expensive, many vendors are including AI components in their standard offerings, as well as access to Artificial Intelligence as a Service (AIaaS) platforms. AI as a Service allows individuals and companies to experiment with AI for various business purposes and sample multiple platforms before making a commitment. Popular AI cloud offerings include Amazon AI services, IBM Watson Assistant, Microsoft Cognitive Services and Google AI services. While AI tools present a range of new functionality for businesses ,the use of artificial intelligence raises ethical questions. This is because deep learning algorithms, which underpin many of the most advanced AI tools, are only as smart as the data they are given in training. Because a human selects what data should be used for training an AI program, the potential for human bias is inherent and must be monitored closely.\n",
            "Some industry experts believe that the term artificial intelligence is too closely linked to popular culture, causing the general public to have unrealistic fears about artificial intelligence and improbable expectations about how it will change the workplace and life in general.\n",
            "Researchers and marketers hope the label augmented intelligence, which has a more neutral connotation, will help people understand that AI will simply improve products and services, not replace the humans that use them. Knowledge engineering is a core part of AI research. Machines can often act and react like humans only if they have abundant information relating to the world. Artificial intelligence must have access to objects, categories, properties and relations between all of them to implement knowledge engineering. Initiating common sense, reasoning and problem-solving power in machines is a difficult and tedious task.Machine learning is also a core part of AI.\n",
            "There are a number of different forms of learning as applied to artificial intelligence. The simplest is learning by trial and error. For example, a simple computer program for solving mate-in-one chess problems might try moves at random until mate is found. The program might then store the solution with the position so that the next time the computer encountered the same position it would recall the solution. This simple memorizing of individual items and procedures—known as rote learning—is relatively easy to implement on a computer. More challenging is the problem of implementing what is called generalization. Generalization involves applying past experience to analogous new situations. For example, a program that learns the past tense of regular English verbs by rote will not be able to produce the past tense of a word such as jump unless it previously had been presented with jumped, whereas a program that is able to generalize can learn the “add ed” rule and so form the past tense of jump based on experience with similar verbs.\n",
            "Learning without any kind of supervision requires an ability to identify patterns in streams of inputs, whereas learning with adequate supervision involves classification and numerical regressions. Classification determines the category an object belongs to and regression deals with obtaining a set of numerical input or output examples, thereby discovering functions enabling the generation of suitable outputs from respective inputs. Mathematical analysis of machine learning algorithms and their performance is a well-defined branch of theoretical computer science often referred to as computational learning theory. Machine perception deals with the capability to use sensory inputs to deduce the different aspects of the world, while computer vision is the power to analyze visual inputs with a few sub-problems such as facial, object and gesture recognition. Robotics is also a major field related to AI. Robots require intelligence to handle tasks such as object manipulation and navigation, along with sub-problems of localization, motion planning and mapping.\n",
            "To reason is to draw inferences appropriate to the situation. Inferences are classified as either deductive or inductive. An example of the former is, “Fred must be in either the museum or the café. He is not in the café; therefore he is in the museum,” and of the latter, “Previous accidents of this sort were caused by instrument failure; therefore this accident was caused by instrument failure.” The most significant difference between these forms of reasoning is that in the deductive case the truth of the premises guarantees the truth of the conclusion, whereas in the inductive case the truth of the premise lends support to the conclusion without giving absolute assurance. Inductive reasoning is common in science, where data are collected and tentative models are developed to describe and predict future behaviour—until the appearance of anomalous data forces the model to be revised. Deductive reasoning is common in mathematics and logic, where elaborate structures of irrefutable theorems are built up from a small set of basic axioms and rules.\n",
            "There has been considerable success in programming computers to draw inferences, especially deductive inferences. However, true reasoning involves more than just drawing inferences; it involves drawing inferences relevant to the solution of the particular task or situation. This is one of the hardest problems confronting AI.\n",
            "Problem solving, particularly in artificial intelligence, may be characterized as a systematic search through a range of possible actions in order to reach some predefined goal or solution. Problem-solving methods divide into special purpose and general purpose. A special-purpose method is tailor-made for a particular problem and often exploits very specific features of the situation in which the problem is embedded. In contrast, a general-purpose method is applicable to a wide variety of problems. One general-purpose technique used in AI is means-end analysis—a step-by-step, or incremental, reduction of the difference between the current state and the final goal. The program selects actions from a list of means—in the case of a simple robot this might consist of PICKUP, PUTDOWN, MOVEFORWARD, MOVEBACK, MOVELEFT, and MOVERIGHT—until the goal is reached.\n",
            "In perception the environment is scanned by means of various sensory organs, real or artificial, and the scene is decomposed into separate objects in various spatial relationships. Analysis is complicated by the fact that an object may appear different depending on the angle from which it is viewed, the direction and intensity of illumination in the scene, and how much the object contrasts with the surrounding field.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "vJcQon60lYmX",
        "colab_type": "code",
        "outputId": "ad4d04b7-7ae0-49b3-ebe3-aa719799a402",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 70
        }
      },
      "source": [
        "characters = list(set(text))\n",
        "vocab_length = len(characters)\n",
        "print(characters)\n",
        "print(f'Number of unique characters: {vocab_length}')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "['S', 'n', 'p', 's', 'e', ' ', 'm', 'U', 'z', '.', 'r', 'a', 'q', 'D', '1', '-', 'i', '(', 'R', 'N', 'y', 'c', 'l', 'C', 'f', 'M', 'B', '4', 'W', '“', ';', '9', 'P', 'v', 'o', 'b', ',', 'h', 'V', 'G', '—', 'O', '\\n', 'u', \"'\", 't', 'd', 'k', ':', 'g', 'K', '”', 'é', 'I', 'F', '’', 'A', '0', 'E', 'j', 'L', ')', '?', 'H', 'x', 'T', 'w']\n",
            "Number of unique characters: 67\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "E2LeNuEDlYhJ",
        "colab_type": "code",
        "outputId": "a66d96cd-c61e-487c-d379-c2659088187f",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1142
        }
      },
      "source": [
        "char_to_int = dict([(char, i) for i, char in enumerate(characters)])\n",
        "char_to_int"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "{'\\n': 42,\n",
              " ' ': 5,\n",
              " \"'\": 44,\n",
              " '(': 17,\n",
              " ')': 61,\n",
              " ',': 36,\n",
              " '-': 15,\n",
              " '.': 9,\n",
              " '0': 57,\n",
              " '1': 14,\n",
              " '4': 27,\n",
              " '9': 31,\n",
              " ':': 48,\n",
              " ';': 30,\n",
              " '?': 62,\n",
              " 'A': 56,\n",
              " 'B': 26,\n",
              " 'C': 23,\n",
              " 'D': 13,\n",
              " 'E': 58,\n",
              " 'F': 54,\n",
              " 'G': 39,\n",
              " 'H': 63,\n",
              " 'I': 53,\n",
              " 'K': 50,\n",
              " 'L': 60,\n",
              " 'M': 25,\n",
              " 'N': 19,\n",
              " 'O': 41,\n",
              " 'P': 32,\n",
              " 'R': 18,\n",
              " 'S': 0,\n",
              " 'T': 65,\n",
              " 'U': 7,\n",
              " 'V': 38,\n",
              " 'W': 28,\n",
              " 'a': 11,\n",
              " 'b': 35,\n",
              " 'c': 21,\n",
              " 'd': 46,\n",
              " 'e': 4,\n",
              " 'f': 24,\n",
              " 'g': 49,\n",
              " 'h': 37,\n",
              " 'i': 16,\n",
              " 'j': 59,\n",
              " 'k': 47,\n",
              " 'l': 22,\n",
              " 'm': 6,\n",
              " 'n': 1,\n",
              " 'o': 34,\n",
              " 'p': 2,\n",
              " 'q': 12,\n",
              " 'r': 10,\n",
              " 's': 3,\n",
              " 't': 45,\n",
              " 'u': 43,\n",
              " 'v': 33,\n",
              " 'w': 66,\n",
              " 'x': 64,\n",
              " 'y': 20,\n",
              " 'z': 8,\n",
              " 'é': 52,\n",
              " '—': 40,\n",
              " '’': 55,\n",
              " '“': 29,\n",
              " '”': 51}"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 4
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "3A--N_D3lYe6",
        "colab_type": "code",
        "outputId": "1049aaf4-39d9-456c-e0a5-f74b30b4a29a",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1142
        }
      },
      "source": [
        "int_to_char = dict([(i, char) for i, char in enumerate(characters)])\n",
        "int_to_char"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "{0: 'S',\n",
              " 1: 'n',\n",
              " 2: 'p',\n",
              " 3: 's',\n",
              " 4: 'e',\n",
              " 5: ' ',\n",
              " 6: 'm',\n",
              " 7: 'U',\n",
              " 8: 'z',\n",
              " 9: '.',\n",
              " 10: 'r',\n",
              " 11: 'a',\n",
              " 12: 'q',\n",
              " 13: 'D',\n",
              " 14: '1',\n",
              " 15: '-',\n",
              " 16: 'i',\n",
              " 17: '(',\n",
              " 18: 'R',\n",
              " 19: 'N',\n",
              " 20: 'y',\n",
              " 21: 'c',\n",
              " 22: 'l',\n",
              " 23: 'C',\n",
              " 24: 'f',\n",
              " 25: 'M',\n",
              " 26: 'B',\n",
              " 27: '4',\n",
              " 28: 'W',\n",
              " 29: '“',\n",
              " 30: ';',\n",
              " 31: '9',\n",
              " 32: 'P',\n",
              " 33: 'v',\n",
              " 34: 'o',\n",
              " 35: 'b',\n",
              " 36: ',',\n",
              " 37: 'h',\n",
              " 38: 'V',\n",
              " 39: 'G',\n",
              " 40: '—',\n",
              " 41: 'O',\n",
              " 42: '\\n',\n",
              " 43: 'u',\n",
              " 44: \"'\",\n",
              " 45: 't',\n",
              " 46: 'd',\n",
              " 47: 'k',\n",
              " 48: ':',\n",
              " 49: 'g',\n",
              " 50: 'K',\n",
              " 51: '”',\n",
              " 52: 'é',\n",
              " 53: 'I',\n",
              " 54: 'F',\n",
              " 55: '’',\n",
              " 56: 'A',\n",
              " 57: '0',\n",
              " 58: 'E',\n",
              " 59: 'j',\n",
              " 60: 'L',\n",
              " 61: ')',\n",
              " 62: '?',\n",
              " 63: 'H',\n",
              " 64: 'x',\n",
              " 65: 'T',\n",
              " 66: 'w'}"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "58oqFgyHnkt2",
        "colab_type": "code",
        "outputId": "930e91c9-cd06-4ade-826a-79e507a9789f",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 16834
        }
      },
      "source": [
        "int_text = [char_to_int[char] for char in text]\n",
        "int_text"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "[56,\n",
              " 10,\n",
              " 45,\n",
              " 16,\n",
              " 24,\n",
              " 16,\n",
              " 21,\n",
              " 16,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 45,\n",
              " 4,\n",
              " 22,\n",
              " 22,\n",
              " 16,\n",
              " 49,\n",
              " 4,\n",
              " 1,\n",
              " 21,\n",
              " 4,\n",
              " 5,\n",
              " 17,\n",
              " 56,\n",
              " 53,\n",
              " 61,\n",
              " 5,\n",
              " 16,\n",
              " 3,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 3,\n",
              " 16,\n",
              " 6,\n",
              " 43,\n",
              " 22,\n",
              " 11,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 37,\n",
              " 43,\n",
              " 6,\n",
              " 11,\n",
              " 1,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 45,\n",
              " 4,\n",
              " 22,\n",
              " 22,\n",
              " 16,\n",
              " 49,\n",
              " 4,\n",
              " 1,\n",
              " 21,\n",
              " 4,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 21,\n",
              " 4,\n",
              " 3,\n",
              " 3,\n",
              " 4,\n",
              " 3,\n",
              " 5,\n",
              " 35,\n",
              " 20,\n",
              " 5,\n",
              " 6,\n",
              " 11,\n",
              " 21,\n",
              " 37,\n",
              " 16,\n",
              " 1,\n",
              " 4,\n",
              " 3,\n",
              " 36,\n",
              " 5,\n",
              " 4,\n",
              " 3,\n",
              " 2,\n",
              " 4,\n",
              " 21,\n",
              " 16,\n",
              " 11,\n",
              " 22,\n",
              " 22,\n",
              " 20,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 43,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 5,\n",
              " 3,\n",
              " 20,\n",
              " 3,\n",
              " 45,\n",
              " 4,\n",
              " 6,\n",
              " 3,\n",
              " 9,\n",
              " 5,\n",
              " 65,\n",
              " 37,\n",
              " 4,\n",
              " 3,\n",
              " 4,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 21,\n",
              " 4,\n",
              " 3,\n",
              " 3,\n",
              " 4,\n",
              " 3,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 21,\n",
              " 22,\n",
              " 43,\n",
              " 46,\n",
              " 4,\n",
              " 5,\n",
              " 22,\n",
              " 4,\n",
              " 11,\n",
              " 10,\n",
              " 1,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 17,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 11,\n",
              " 21,\n",
              " 12,\n",
              " 43,\n",
              " 16,\n",
              " 3,\n",
              " 16,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 6,\n",
              " 11,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 5,\n",
              " 11,\n",
              " 1,\n",
              " 46,\n",
              " 5,\n",
              " 10,\n",
              " 43,\n",
              " 22,\n",
              " 4,\n",
              " 3,\n",
              " 5,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 43,\n",
              " 3,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 6,\n",
              " 11,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 61,\n",
              " 36,\n",
              " 5,\n",
              " 10,\n",
              " 4,\n",
              " 11,\n",
              " 3,\n",
              " 34,\n",
              " 1,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 17,\n",
              " 43,\n",
              " 3,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 10,\n",
              " 43,\n",
              " 22,\n",
              " 4,\n",
              " 3,\n",
              " 5,\n",
              " 45,\n",
              " 34,\n",
              " 5,\n",
              " 10,\n",
              " 4,\n",
              " 11,\n",
              " 21,\n",
              " 37,\n",
              " 5,\n",
              " 11,\n",
              " 2,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 64,\n",
              " 16,\n",
              " 6,\n",
              " 11,\n",
              " 45,\n",
              " 4,\n",
              " 5,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 46,\n",
              " 4,\n",
              " 24,\n",
              " 16,\n",
              " 1,\n",
              " 16,\n",
              " 45,\n",
              " 4,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 1,\n",
              " 21,\n",
              " 22,\n",
              " 43,\n",
              " 3,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 3,\n",
              " 61,\n",
              " 5,\n",
              " 11,\n",
              " 1,\n",
              " 46,\n",
              " 5,\n",
              " 3,\n",
              " 4,\n",
              " 22,\n",
              " 24,\n",
              " 15,\n",
              " 21,\n",
              " 34,\n",
              " 10,\n",
              " 10,\n",
              " 4,\n",
              " 21,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 9,\n",
              " 42,\n",
              " 32,\n",
              " 11,\n",
              " 10,\n",
              " 45,\n",
              " 16,\n",
              " 21,\n",
              " 43,\n",
              " 22,\n",
              " 11,\n",
              " 10,\n",
              " 5,\n",
              " 11,\n",
              " 2,\n",
              " 2,\n",
              " 22,\n",
              " 16,\n",
              " 21,\n",
              " 11,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 3,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 56,\n",
              " 53,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 21,\n",
              " 22,\n",
              " 43,\n",
              " 46,\n",
              " 4,\n",
              " 5,\n",
              " 4,\n",
              " 64,\n",
              " 2,\n",
              " 4,\n",
              " 10,\n",
              " 45,\n",
              " 5,\n",
              " 3,\n",
              " 20,\n",
              " 3,\n",
              " 45,\n",
              " 4,\n",
              " 6,\n",
              " 3,\n",
              " 36,\n",
              " 5,\n",
              " 3,\n",
              " 2,\n",
              " 4,\n",
              " 4,\n",
              " 21,\n",
              " 37,\n",
              " 5,\n",
              " 10,\n",
              " 4,\n",
              " 21,\n",
              " 34,\n",
              " 49,\n",
              " 1,\n",
              " 16,\n",
              " 45,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 5,\n",
              " 11,\n",
              " 1,\n",
              " 46,\n",
              " 5,\n",
              " 6,\n",
              " 11,\n",
              " 21,\n",
              " 37,\n",
              " 16,\n",
              " 1,\n",
              " 4,\n",
              " 5,\n",
              " 33,\n",
              " 16,\n",
              " 3,\n",
              " 16,\n",
              " 34,\n",
              " 1,\n",
              " 9,\n",
              " 5,\n",
              " 56,\n",
              " 10,\n",
              " 45,\n",
              " 16,\n",
              " 24,\n",
              " 16,\n",
              " 21,\n",
              " 16,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 45,\n",
              " 4,\n",
              " 22,\n",
              " 22,\n",
              " 16,\n",
              " 49,\n",
              " 4,\n",
              " 1,\n",
              " 21,\n",
              " 4,\n",
              " 5,\n",
              " 17,\n",
              " 56,\n",
              " 53,\n",
              " 61,\n",
              " 36,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 11,\n",
              " 35,\n",
              " 16,\n",
              " 22,\n",
              " 16,\n",
              " 45,\n",
              " 20,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 11,\n",
              " 5,\n",
              " 46,\n",
              " 16,\n",
              " 49,\n",
              " 16,\n",
              " 45,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 43,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 5,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 43,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 15,\n",
              " 21,\n",
              " 34,\n",
              " 1,\n",
              " 45,\n",
              " 10,\n",
              " 34,\n",
              " 22,\n",
              " 22,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 10,\n",
              " 34,\n",
              " 35,\n",
              " 34,\n",
              " 45,\n",
              " 5,\n",
              " 45,\n",
              " 34,\n",
              " 5,\n",
              " 2,\n",
              " 4,\n",
              " 10,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 6,\n",
              " 5,\n",
              " 45,\n",
              " 11,\n",
              " 3,\n",
              " 47,\n",
              " 3,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 6,\n",
              " 34,\n",
              " 1,\n",
              " 22,\n",
              " 20,\n",
              " 5,\n",
              " 11,\n",
              " 3,\n",
              " 3,\n",
              " 34,\n",
              " 21,\n",
              " 16,\n",
              " 11,\n",
              " 45,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 66,\n",
              " 16,\n",
              " 45,\n",
              " 37,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 45,\n",
              " 4,\n",
              " 22,\n",
              " 22,\n",
              " 16,\n",
              " 49,\n",
              " 4,\n",
              " 1,\n",
              " 45,\n",
              " 5,\n",
              " 35,\n",
              " 4,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 3,\n",
              " 9,\n",
              " 5,\n",
              " 65,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 6,\n",
              " 5,\n",
              " 16,\n",
              " 3,\n",
              " 5,\n",
              " 24,\n",
              " 10,\n",
              " 4,\n",
              " 12,\n",
              " 43,\n",
              " 4,\n",
              " 1,\n",
              " 45,\n",
              " 22,\n",
              " 20,\n",
              " 5,\n",
              " 11,\n",
              " 2,\n",
              " 2,\n",
              " 22,\n",
              " 16,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 45,\n",
              " 34,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 59,\n",
              " 4,\n",
              " 21,\n",
              " 45,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 46,\n",
              " 4,\n",
              " 33,\n",
              " 4,\n",
              " 22,\n",
              " 34,\n",
              " 2,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 3,\n",
              " 20,\n",
              " 3,\n",
              " 45,\n",
              " 4,\n",
              " 6,\n",
              " 3,\n",
              " 5,\n",
              " 4,\n",
              " 1,\n",
              " 46,\n",
              " 34,\n",
              " 66,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 66,\n",
              " 16,\n",
              " 45,\n",
              " 37,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 45,\n",
              " 4,\n",
              " 22,\n",
              " 22,\n",
              " 4,\n",
              " 21,\n",
              " 45,\n",
              " 43,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 21,\n",
              " 4,\n",
              " 3,\n",
              " 3,\n",
              " 4,\n",
              " 3,\n",
              " 5,\n",
              " 21,\n",
              " 37,\n",
              " 11,\n",
              " 10,\n",
              " 11,\n",
              " 21,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 16,\n",
              " 3,\n",
              " 45,\n",
              " 16,\n",
              " 21,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 37,\n",
              " 43,\n",
              " 6,\n",
              " 11,\n",
              " 1,\n",
              " 3,\n",
              " 36,\n",
              " 5,\n",
              " 3,\n",
              " 43,\n",
              " 21,\n",
              " 37,\n",
              " 5,\n",
              " 11,\n",
              " 3,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 11,\n",
              " 35,\n",
              " 16,\n",
              " 22,\n",
              " 16,\n",
              " 45,\n",
              " 20,\n",
              " 5,\n",
              " 45,\n",
              " 34,\n",
              " 5,\n",
              " 10,\n",
              " 4,\n",
              " 11,\n",
              " 3,\n",
              " 34,\n",
              " 1,\n",
              " 36,\n",
              " 5,\n",
              " 46,\n",
              " 16,\n",
              " 3,\n",
              " 21,\n",
              " 34,\n",
              " 33,\n",
              " 4,\n",
              " 10,\n",
              " 5,\n",
              " 6,\n",
              " 4,\n",
              " 11,\n",
              " 1,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 36,\n",
              " 5,\n",
              " 49,\n",
              " 4,\n",
              " 1,\n",
              " 4,\n",
              " 10,\n",
              " 11,\n",
              " 22,\n",
              " 16,\n",
              " 8,\n",
              " 4,\n",
              " 36,\n",
              " 5,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 22,\n",
              " 4,\n",
              " 11,\n",
              " 10,\n",
              " 1,\n",
              " 5,\n",
              " 24,\n",
              " 10,\n",
              " 34,\n",
              " 6,\n",
              " 5,\n",
              " 2,\n",
              " 11,\n",
              " 3,\n",
              " 45,\n",
              " 5,\n",
              " 4,\n",
              " 64,\n",
              " 2,\n",
              " 4,\n",
              " 10,\n",
              " 16,\n",
              " 4,\n",
              " 1,\n",
              " 21,\n",
              " 4,\n",
              " 9,\n",
              " 5,\n",
              " 0,\n",
              " 16,\n",
              " 1,\n",
              " 21,\n",
              " 4,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 46,\n",
              " 4,\n",
              " 33,\n",
              " 4,\n",
              " 22,\n",
              " 34,\n",
              " 2,\n",
              " 6,\n",
              " 4,\n",
              " 1,\n",
              " 45,\n",
              " 5,\n",
              " 34,\n",
              " 24,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 46,\n",
              " 16,\n",
              " 49,\n",
              " 16,\n",
              " 45,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 43,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 5,\n",
              " 16,\n",
              " 1,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 5,\n",
              " 14,\n",
              " 31,\n",
              " 27,\n",
              " 57,\n",
              " 3,\n",
              " 36,\n",
              " 5,\n",
              " 16,\n",
              " 45,\n",
              " 5,\n",
              " 37,\n",
              " 11,\n",
              " 3,\n",
              " 5,\n",
              " 35,\n",
              " 4,\n",
              " 4,\n",
              " 1,\n",
              " 5,\n",
              " 46,\n",
              " 4,\n",
              " 6,\n",
              " 34,\n",
              " 1,\n",
              " 3,\n",
              " 45,\n",
              " 10,\n",
              " 11,\n",
              " 45,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 11,\n",
              " 45,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 43,\n",
              " 45,\n",
              " 4,\n",
              " 10,\n",
              " 3,\n",
              " 5,\n",
              " 21,\n",
              " 11,\n",
              " 1,\n",
              " 5,\n",
              " 35,\n",
              " 4,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 49,\n",
              " 10,\n",
              " 11,\n",
              " 6,\n",
              " 6,\n",
              " 4,\n",
              " 46,\n",
              " 5,\n",
              " 45,\n",
              " 34,\n",
              " 5,\n",
              " 21,\n",
              " 11,\n",
              " 10,\n",
              " 10,\n",
              " 20,\n",
              " 5,\n",
              " 34,\n",
              " 43,\n",
              " 45,\n",
              " 5,\n",
              " 33,\n",
              " 4,\n",
              " 10,\n",
              " 20,\n",
              " 5,\n",
              " 21,\n",
              " 34,\n",
              " 6,\n",
              " 2,\n",
              " 22,\n",
              " 4,\n",
              " 64,\n",
              " 5,\n",
              " 45,\n",
              " 11,\n",
              " 3,\n",
              " 47,\n",
              " 3,\n",
              " 40,\n",
              " 11,\n",
              " 3,\n",
              " 36,\n",
              " 5,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 4,\n",
              " 64,\n",
              " 11,\n",
              " 6,\n",
              " 2,\n",
              " 22,\n",
              " 4,\n",
              " 36,\n",
              " 5,\n",
              " 46,\n",
              " 16,\n",
              " 3,\n",
              " 21,\n",
              " 34,\n",
              " 33,\n",
              " 4,\n",
              " 10,\n",
              " 16,\n",
              " 1,\n",
              " 49,\n",
              " 5,\n",
              " 2,\n",
              " 10,\n",
              " 34,\n",
              " 34,\n",
              " 24,\n",
              " 3,\n",
              " 5,\n",
              " 24,\n",
              " 34,\n",
              " 10,\n",
              " 5,\n",
              " 6,\n",
              " 11,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 6,\n",
              " 11,\n",
              " 45,\n",
              " 16,\n",
              " 21,\n",
              " 11,\n",
              " 22,\n",
              " 5,\n",
              " 45,\n",
              " 37,\n",
              " 4,\n",
              " 34,\n",
              " 10,\n",
              " 4,\n",
              " 6,\n",
              " 3,\n",
              " 5,\n",
              " ...]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "F2UFBUgfn-wJ",
        "colab_type": "code",
        "outputId": "1d2e425c-cf53-455e-e963-0b12d89bd817",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 67
        }
      },
      "source": [
        "print(f'Total sequence length of the text: {len(int_text)}')\n",
        "print(f'First 20 integers: {int_text[:20]}')\n",
        "print(f'First 20 characters: {\"\".join([int_to_char[i] for i in int_text[:20]])}')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Total sequence length of the text: 9792\n",
            "First 20 integers: [56, 10, 45, 16, 24, 16, 21, 16, 11, 22, 5, 16, 1, 45, 4, 22, 22, 16, 49, 4]\n",
            "First 20 characters: Artificial intellige\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "3PF8ysC8n-so",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def one_hot(ints, vocab_length = vocab_length):\n",
        "    outputs = nd.zeros((len(ints), vocab_length))\n",
        "    for i, idx in enumerate(ints):\n",
        "        outputs[i, idx] = 1.0\n",
        "    return outputs"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jSNFuFern-rE",
        "colab_type": "code",
        "outputId": "e0b7ba19-cbe5-47e6-8f04-ccc5cc5a8cba",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 218
        }
      },
      "source": [
        "print('Before one hot:')\n",
        "print(int_text[:20])\n",
        "print('After one hot:')\n",
        "print(one_hot(int_text[:20]))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Before one hot:\n",
            "[56, 10, 45, 16, 24, 16, 21, 16, 11, 22, 5, 16, 1, 45, 4, 22, 22, 16, 49, 4]\n",
            "After one hot:\n",
            "\n",
            "[[0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " ...\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]]\n",
            "<NDArray 20x67 @cpu(0)>\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "VeOFs9OdqDAR",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def onehot_to_text(embeddings):\n",
        "    outputs = \"\"\n",
        "    ints = nd.argmax(embeddings, axis = 1).asnumpy()\n",
        "    for i in ints:\n",
        "        outputs += int_to_char[i]\n",
        "    return outputs"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "uX0Ut6_dqaRD",
        "colab_type": "code",
        "outputId": "e0438161-b6ce-4d09-871a-cb0745bbc2f2",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 235
        }
      },
      "source": [
        "onehot = one_hot(int_text[:20])\n",
        "print('First 20 characters in Onehot:')\n",
        "print(onehot)\n",
        "print('\\nAfter converting First 20 one hot embeddings to text:')\n",
        "print(f'\"{onehot_to_text(onehot)}\"')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "First 20 characters in Onehot:\n",
            "\n",
            "[[0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " ...\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]\n",
            " [0. 0. 0. ... 0. 0. 0.]]\n",
            "<NDArray 20x67 @cpu(0)>\n",
            "\n",
            "After converting First 20 one hot embeddings to text:\n",
            "\"Artificial intellige\"\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-1cIWC8aq0s5",
        "colab_type": "text"
      },
      "source": [
        "##Building the dataset"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ihhJIxcsq4f1",
        "colab_type": "code",
        "outputId": "4b4207d5-bae9-4398-ae63-0b8807047bb2",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        }
      },
      "source": [
        "seq_length = 32\n",
        "num_samples = (len(int_text) - 1)//seq_length\n",
        "dataset = one_hot(int_text[: seq_length * num_samples]).reshape((num_samples, seq_length, vocab_length))\n",
        "dataset.shape"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "(305, 32, 67)"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 12
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "z087k0tkq4bU",
        "colab_type": "code",
        "outputId": "22e6db93-164a-4ca0-a739-6eb5da7ea9bc",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 50
        }
      },
      "source": [
        "output = onehot_to_text(dataset[0])\n",
        "print(output)\n",
        "print(f'Sequence length: {len(output)}')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Artificial intelligence (AI) is \n",
            "Sequence length: 32\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "QrWeMXJ3q4aF",
        "colab_type": "code",
        "outputId": "b54367df-f16b-49e7-c175-d63eb2e1e897",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 50
        }
      },
      "source": [
        "batch_size = 8\n",
        "batches = dataset.shape[0] // batch_size\n",
        "print(f'Number of samples in dataset: {dataset.shape[0]}')\n",
        "print(f'Number of batches: {batches}')"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Number of samples in dataset: 305\n",
            "Number of batches: 38\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "GSgXjd8Gq4ZL",
        "colab_type": "code",
        "outputId": "d6bee043-c02d-43aa-859e-7f83b428f138",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 84
        }
      },
      "source": [
        "train_features = dataset[:batches * batch_size]\n",
        "print(train_features.shape)\n",
        "train_features = train_features.reshape((batch_size, batches, seq_length, vocab_length))\n",
        "print(train_features.shape)\n",
        "train_features = train_features.swapaxes(0, 1)\n",
        "print(train_features.shape)\n",
        "train_features = train_features.swapaxes(1, 2)\n",
        "print(train_features.shape)\n",
        "\n",
        "# shape == (batches, sequence length, batch size, vocabulary length)"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "(304, 32, 67)\n",
            "(8, 38, 32, 67)\n",
            "(38, 8, 32, 67)\n",
            "(38, 32, 8, 67)\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TxKlVMKeq4YM",
        "colab_type": "code",
        "outputId": "9978081b-2510-499f-d3a7-2962ea748ca1",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 437
        }
      },
      "source": [
        "for i in range(5):\n",
        "    print(\"Batch %s:\\n %s \\n %s \\n\\n\" % (i, onehot_to_text(train_features[i, :, 0]), onehot_to_text(train_features[i, :, 1])))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Batch 0:\n",
            " Artificial intelligence (AI) is  \n",
            " ks requiring much everyday knowl \n",
            "\n",
            "\n",
            "Batch 1:\n",
            " the simulation of human intellig \n",
            " edge. On the other hand, some pr \n",
            "\n",
            "\n",
            "Batch 2:\n",
            " ence processes by machines, espe \n",
            " ograms have attained the perform \n",
            "\n",
            "\n",
            "Batch 3:\n",
            " cially computer systems. These p \n",
            " ance levels of human experts and \n",
            "\n",
            "\n",
            "Batch 4:\n",
            " rocesses include learning (the a \n",
            "  professionals in performing cer \n",
            "\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "OxmTEWfzzrx7",
        "colab_type": "code",
        "outputId": "ed1fb318-8fa1-4217-b129-3cd70dc0c203",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 84
        }
      },
      "source": [
        "train_labels = one_hot(int_text[1:seq_length*num_samples+1])\n",
        "print(train_labels.shape)\n",
        "train_labels = train_labels.reshape((batch_size, batches, seq_length, vocab_length))\n",
        "print(train_labels.shape)\n",
        "train_labels = nd.swapaxes(train_labels, 0, 1)\n",
        "print(train_labels.shape)\n",
        "train_labels = nd.swapaxes(train_labels, 1, 2)\n",
        "print(train_labels.shape)"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "(9760, 67)\n",
            "(8, 38, 32, 67)\n",
            "(38, 8, 32, 67)\n",
            "(38, 32, 8, 67)\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "FbMeyhCFzrql",
        "colab_type": "code",
        "outputId": "efe3775d-c3ee-447c-8d13-ee0a8d56b68b",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 50
        }
      },
      "source": [
        "print(onehot_to_text(train_features[0, :, 4]))\n",
        "print(onehot_to_text(train_labels[0, :, 4]))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "mmon sense, reasoning and proble\n",
            "mon sense, reasoning and problem\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "g8TkdY970mKg",
        "colab_type": "text"
      },
      "source": [
        "##Initializing parameters for our model"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_p8RFnKw0qI4",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "num_inputs = vocab_length\n",
        "num_hidden = 512\n",
        "num_outputs = vocab_length\n",
        "\n",
        "Wxg = nd.random.normal(shape = (num_inputs, num_hidden), ctx = ctx) * .001\n",
        "Wxi = nd.random.normal(shape = (num_inputs, num_hidden), ctx = ctx) * .001\n",
        "Wxf = nd.random.normal(shape = (num_inputs, num_hidden), ctx = ctx) * .001\n",
        "Wxo = nd.random.normal(shape = (num_inputs, num_hidden), ctx = ctx) * .001\n",
        "\n",
        "Whg = nd.random.normal(shape = (num_hidden, num_hidden), ctx=ctx)* .01\n",
        "Whi = nd.random.normal(shape = (num_hidden, num_hidden), ctx=ctx)* .01\n",
        "Whf = nd.random.normal(shape = (num_hidden, num_hidden), ctx=ctx)* .01\n",
        "Who = nd.random.normal(shape = (num_hidden, num_hidden), ctx=ctx)* .01\n",
        "\n",
        "bg = nd.random.normal(shape = num_hidden, ctx = ctx) * .001\n",
        "bi = nd.random.normal(shape = num_hidden, ctx = ctx) * .001\n",
        "bf = nd.random.normal(shape = num_hidden, ctx = ctx) * .001\n",
        "bo = nd.random.normal(shape = num_hidden, ctx = ctx) * .001\n",
        "\n",
        "Why = nd.random.normal(shape = (num_hidden, num_outputs), ctx = ctx) * .001\n",
        "by = nd.random.normal(shape=num_outputs, ctx = ctx) * .001\n",
        "\n",
        "params = [Wxg, Wxi, Wxf, Wxo, Whg, Whi, Whf, Who, bg, bi, bf, bo, Why, by]\n",
        "\n",
        "for param in params:\n",
        "    param.attach_grad()"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "bTGOYb7b0qDO",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def softmax(linear):\n",
        "    exp = nd.exp((linear - nd.max(linear, axis = 1).reshape((-1, 1))))\n",
        "    partition = nd.sum(exp, axis = 1).reshape((-1, 1))\n",
        "    return exp / partition"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "-Xgf_bGU1OJg",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def lstm(inputs, h, c):\n",
        "    outputs = []\n",
        "    for X in inputs:\n",
        "        g = nd.tanh(nd.dot(X, Wxg) + nd.dot(h, Whg) + bg)\n",
        "        \n",
        "        i = nd.sigmoid(nd.dot(X, Wxi) + nd.dot(h, Whi) + bi)\n",
        "        f = nd.sigmoid(nd.dot(X, Wxf) + nd.dot(h, Whf) + bf)\n",
        "        o = nd.sigmoid(nd.dot(X, Wxo) + nd.dot(h, Who) + bo)\n",
        "        \n",
        "        c = f * c + i * g\n",
        "        h = o * nd.tanh(c)\n",
        "        \n",
        "        linear = nd.dot(h, Why) + by\n",
        "        output = softmax(linear)\n",
        "        outputs.append(output)\n",
        "    return (outputs, h, c)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_ojb_FXh152M",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def generate(prefix, num_chars, temperature=1.0):\n",
        "    string = prefix\n",
        "\n",
        "    prefix_numerical = [char_to_int[char] for char in prefix]\n",
        "    input_sequence = one_hot(prefix_numerical).as_in_context(ctx)\n",
        "\n",
        "    h = nd.zeros(shape = (1, num_hidden), ctx = ctx)\n",
        "    c = nd.zeros(shape = (1, num_hidden), ctx = ctx)\n",
        "\n",
        "    for i in range(num_chars):\n",
        "        outputs, h, c = lstm(input_sequence, h, c)\n",
        "        choice = int(outputs[-1][0].argmax(0).asscalar())\n",
        "        string += int_to_char[choice]\n",
        "        input_sequence = one_hot([choice]).as_in_context(ctx)\n",
        "    return string"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "L9bctEbC6sY6",
        "colab_type": "code",
        "outputId": "293b2fbb-f40a-4ba4-e233-fbe7accbf910",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 54
        }
      },
      "source": [
        "print(generate(\"Artificial intelligence\", 1024))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Artificial intelligencePPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPPP\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UJbClx0_1OGd",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def cross_entropy(pred, label):\n",
        "    return -nd.sum(label * nd.log(pred))"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "WHjdxaUO_2Vj",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def objective(outputs, labels):\n",
        "    total_loss = 0.\n",
        "    for (output, label) in zip(outputs,labels):\n",
        "        total_loss = total_loss + cross_entropy(output, label)\n",
        "    return total_loss / len(outputs)"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "YRJTLBco1OEg",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def sgd(params, lr):\n",
        "    for param in params:\n",
        "        param[:] = param - lr * param.grad"
      ],
      "execution_count": 0,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "WlmjfU8B1N_x",
        "colab_type": "code",
        "outputId": "f97f661b-040a-476b-aeb3-6f15eca38c40",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 3901
        }
      },
      "source": [
        "epochs = 50\n",
        "learning_rate = .5\n",
        "losses = []\n",
        "\n",
        "for epoch in range(epochs):\n",
        "    if (epoch + 1) % 50 == 0:\n",
        "        learning_rate = learning_rate / 2.0\n",
        "    h = nd.zeros(shape = (batch_size, num_hidden), ctx = ctx)\n",
        "    c = nd.zeros(shape = (batch_size, num_hidden), ctx = ctx)\n",
        "    for i in range(batches):\n",
        "        features = train_features[i].as_in_context(ctx)\n",
        "        labels = train_labels[i].as_in_context(ctx)\n",
        "        with autograd.record():\n",
        "            outputs, h, c = lstm(features, h, c)\n",
        "            loss = objective(outputs, labels)\n",
        "            loss.backward()\n",
        "        sgd(params, learning_rate)\n",
        "    \n",
        "    losses.append(loss.asscalar())\n",
        "    print(f'\\nEpoch: {epoch} | Loss: {loss.asscalar():.5f}')\n",
        "    print(generate(\"Artificial intelligence\", 1024))\n",
        "    print(generate(\"Research in AI has focused chiefly on\", 1024))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "\n",
            "Epoch: 0 | Loss: 24.66238\n",
            "Artificial intelligence                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                \n",
            "Research in AI has focused chiefly on                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                \n",
            "\n",
            "Epoch: 1 | Loss: 24.45160\n",
            "Artificial intelligence                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                \n",
            "Research in AI has focused chiefly on                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                \n",
            "\n",
            "Epoch: 2 | Loss: 24.22040\n",
            "Artificial intelligence   e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e\n",
            "Research in AI has focused chiefly on  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e  e \n",
            "\n",
            "Epoch: 3 | Loss: 23.66904\n",
            "Artificial intelligence t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t\n",
            "Research in AI has focused chiefly on t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t t in t\n",
            "\n",
            "Epoch: 4 | Loss: 22.29901\n",
            "Artificial intelligence te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te \n",
            "Research in AI has focused chiefly on te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te \n",
            "\n",
            "Epoch: 5 | Loss: 21.28906\n",
            "Artificial intelligence te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te \n",
            "Research in AI has focused chiefly on te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te te \n",
            "\n",
            "Epoch: 6 | Loss: 20.70437\n",
            "Artificial intelligence the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 7 | Loss: 20.13337\n",
            "Artificial intelligence the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 8 | Loss: 19.71829\n",
            "Artificial intelligence the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 9 | Loss: 19.41806\n",
            "Artificial intelligencenting intitine the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the t\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 10 | Loss: 19.09576\n",
            "Artificial intelligencenting intiting in the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the th\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 11 | Loss: 18.78466\n",
            "Artificial intelligencenting in the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 12 | Loss: 18.41501\n",
            "Artificial intelligence the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 13 | Loss: 18.00991\n",
            "Artificial intelligence antion in the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the t\n",
            "Research in AI has focused chiefly on the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the the\n",
            "\n",
            "Epoch: 14 | Loss: 17.58200\n",
            "Artificial intelligence and in the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and \n",
            "Research in AI has focused chiefly on the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and\n",
            "\n",
            "Epoch: 15 | Loss: 17.17281\n",
            "Artificial intelligence in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and \n",
            "Research in AI has focused chiefly on the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in \n",
            "\n",
            "Epoch: 16 | Loss: 16.77721\n",
            "Artificial intelligence in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and \n",
            "Research in AI has focused chiefly on the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in \n",
            "\n",
            "Epoch: 17 | Loss: 16.37129\n",
            "Artificial intelligence in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and \n",
            "Research in AI has focused chiefly on the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in \n",
            "\n",
            "Epoch: 18 | Loss: 15.95439\n",
            "Artificial intelligence in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and \n",
            "Research in AI has focused chiefly on the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in the and in \n",
            "\n",
            "Epoch: 19 | Loss: 15.56945\n",
            "Artificial intelligence in the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the \n",
            "Research in AI has focused chiefly on the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and the and\n",
            "\n",
            "Epoch: 20 | Loss: 15.24113\n",
            "Artificial intelligence or the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the \n",
            "Research in AI has focused chiefly on the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of the sor the sor the promples of\n",
            "\n",
            "Epoch: 21 | Loss: 14.89568\n",
            "Artificial intelligence or the sing in the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor \n",
            "Research in AI has focused chiefly on the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor\n",
            "\n",
            "Epoch: 22 | Loss: 14.59116\n",
            "Artificial intelligence or the sing in the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor \n",
            "Research in AI has focused chiefly on the sing in the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the\n",
            "\n",
            "Epoch: 23 | Loss: 14.07512\n",
            "Artificial intelligence or the sing in the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor \n",
            "Research in AI has focused chiefly on the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor the sor\n",
            "\n",
            "Epoch: 24 | Loss: 13.68519\n",
            "Artificial intelligence or in the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand \n",
            "Research in AI has focused chiefly on the somple the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the pand the sore the \n",
            "\n",
            "Epoch: 25 | Loss: 13.23531\n",
            "Artificial intelligence or in in the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pand the pa\n",
            "Research in AI has focused chiefly on the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of t\n",
            "\n",
            "Epoch: 26 | Loss: 12.94942\n",
            "Artificial intelligence or infirent and of the past of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment o\n",
            "Research in AI has focused chiefly on the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of the soment of t\n",
            "\n",
            "Epoch: 27 | Loss: 12.77896\n",
            "Artificial intelligence or in the soment of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of \n",
            "Research in AI has focused chiefly on the soment and of the soment of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the sinces an of the s\n",
            "\n",
            "Epoch: 28 | Loss: 12.45385\n",
            "Artificial intelligence or indurent and of the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in\n",
            "Research in AI has focused chiefly on the sollicith of the sinces and of the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in in the past to in i\n",
            "\n",
            "Epoch: 29 | Loss: 12.06728\n",
            "Artificial intelligence or indingent and of the sore the dingering in the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infirent an of the sinces or infire\n",
            "Research in AI has focused chiefly on the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of the sinces of t\n",
            "\n",
            "Epoch: 30 | Loss: 11.94259\n",
            "Artificial intelligence or in the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects \n",
            "Research in AI has focused chiefly on the past to in the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the solects of the\n",
            "\n",
            "Epoch: 31 | Loss: 11.35763\n",
            "Artificial intelligence or indinial in the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on \n",
            "Research in AI has focused chiefly on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the past on the\n",
            "\n",
            "Epoch: 32 | Loss: 11.61892\n",
            "Artificial intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intellige\n",
            "Research in AI has focused chiefly on the solection intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intelligence intellig\n",
            "\n",
            "Epoch: 33 | Loss: 10.72573\n",
            "Artificial intelligence or in the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simulact of the simular ally of the simul\n",
            "Research in AI has focused chiefly on the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the past to the\n",
            "\n",
            "Epoch: 34 | Loss: 9.95154\n",
            "Artificial intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the sinuar or human intelligence or in the\n",
            "Research in AI has focused chiefly on the past to the particular tasks in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solects of in in the solution of the solec\n",
            "\n",
            "Epoch: 35 | Loss: 9.86900\n",
            "Artificial intelligence and inferences and of in the particular the particular task are the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution \n",
            "Research in AI has focused chiefly on her burres or inductive and of in the particular the particular task are the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the solution on the simular or in the forment on the \n",
            "\n",
            "Epoch: 36 | Loss: 9.73243\n",
            "Artificial intelligence of the simular tasks in the simular maching coman the hardication of the simular ta the different and of in the for in man buith of in the forment dith the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering with of the formering\n",
            "Research in AI has focused chiefly on human intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial intelligence the hartificial in\n",
            "\n",
            "Epoch: 37 | Loss: 9.16019\n",
            "Artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or inductive AI.\n",
            "There are artificial intelligence or \n",
            "Research in AI has focused chiefly on the sinced AI intelligen eneralize can of the solution on the since the past to learning intelligence and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experience or in the seneral proserts and sicular the intensed the particular task are the for experienc\n",
            "\n",
            "Epoch: 38 | Loss: 8.97581\n",
            "Artificial intelligence the simular machine lision relation on the sing as mary the angle to new characterize human intelligence withoum particular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular\n",
            "Research in AI has focused chiefly on the simuration of the simular machine lision relation on the sing as mary the angle to new characterize human intelligence withoum particular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten in the carticular task as the fire can beten\n",
            "\n",
            "Epoch: 39 | Loss: 8.36437\n",
            "Artificial intelligence the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy of inductive or in is the past to the sienced widire masy o\n",
            "Research in AI has focused chiefly on and migicauring in the simular objects in care of AI in is to dere processed core is to hery are the fires as object of the simple mandingicuan and moofled AI simular objects in care of a simulaic object of the simple mandingicuan an AI in is to dere processed core is to hery are the fires as object of the simple mandingicuan and moofled AI simular objects in care of a simulaic object of the simple mandingicuan an AI in is to dere processed core is to hery are the fires as object of the simple mandingicuan and moofled AI simular objects in care of a simulaic object of the simple mandingicuan an AI in is to dere processed core is to hery are the fires as object of the simple mandingicuan and moofled AI simular objects in care of a simulaic object of the simple mandingicuan an AI in is to dere processed core is to hery are the fires as object of the simple mandingicuan and moofled AI simular objects in care of a simulaic object of the simple mandingicuan an AI in is to dere processed core is to hery are the fi\n",
            "\n",
            "Epoch: 40 | Loss: 8.27587\n",
            "Artificial intelligence and mast the simical regniting in the simular mean in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simul\n",
            "Research in AI has focused chiefly on the formerice of the particuaran to intelligence (AI) AI simular the fart of the past tense of the particuaran to id ind mast the simical regniting in the simular mean in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the simulial in the \n",
            "\n",
            "Epoch: 41 | Loss: 7.73797\n",
            "Artificial intelligence the simical rean or indumation is the simulais the inferences and mervorment digice untinities. This is the program the program the inverent and mory the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indumen\n",
            "Research in AI has focused chiefly on the foome is disply experiment with sump action in the scener dith the simical the inverent and mory the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument in the scenerated the simical rean or indument \n",
            "\n",
            "Epoch: 42 | Loss: 6.90502\n",
            "Artificial intelligence and moof AI including AI inowledge enelorgenting intelligence and mooflergeneralle dumping lith and the fication of infirience. Anile intelligence as a the ficular ablly fo learning invelugita coreating is the sial complematical rengineering. Anite sithe the similal cablect of intwaling can AI ser ara the differenced asces to a wire simulation of infirience. Anile intelligence as a the ficular ablly fo learning invelugita coreating is the sial complematical rengineering. Anite sithe the similal cablect of intwaling can AI ser ara the differenced asces to a wire simulation of infirience. Anile intelligence as a the ficular ablly fo learning invelugita coreating is the sial complematical rengineering. Anite sithe the similal cablect of intwaling can AI ser ara the differenced asces to a wire simulation of infirience. Anile intelligence as a the ficular ablly fo learning invelugita coreating is the sial complematical rengineering. Anite sithe the similal cablect of intwaling can AI ser ara the differenced asces\n",
            "Research in AI has focused chiefly on alamion and reacfing is include the fires and obleming AI.\n",
            "Problemt to partioulation and sicuaring intelligence and moof AI including AI.\n",
            "Poreation and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the scenerally divical gial and oftenial componer the particular task or ervices and inting AI care of the faritien in the \n",
            "\n",
            "Epoch: 43 | Loss: 9.09781\n",
            "Artificial intelligence in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is \n",
            "Research in AI has focused chiefly on the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the simulation of the food is dividuction in the si\n",
            "\n",
            "Epoch: 44 | Loss: 6.72338\n",
            "Artificial intelligence is toil precessen in computer in the sceneration in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and re\n",
            "Research in AI has focused chiefly on the former is incelleg whe ereppees on the former is include An in either with sumper in the simulation in the sceneration of the program the program the care the will generalizg cumaunen the solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the computer enenderent and machine learning is to AI inferences and machine ligh it in the simular and often and mast the care tesk or in rean experent and reans.\n",
            "Thire present a solution in the sceneraly and tedion relating to the simple to program the com\n",
            "\n",
            "Epoch: 45 | Loss: 6.72061\n",
            "Artificial intelligence to her predicity of intificial intelligence toit is the food is to her burrow whith the past tense of the food is the program to the simulation of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the form\n",
            "Research in AI has focused chiefly on the food is the past tense of the food is the program to the simulation of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the solution of the particularle of the formering in the soluti\n",
            "\n",
            "Epoch: 46 | Loss: 5.96310\n",
            "Artificial intelligence is to in the scene is alor the particular task or situation it the scenerall an thir the simulation of the firilien of intince the solution it the scenerall an this scenering AI inolly enaly to the sifuction and inting the solution of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intoll\n",
            "Research in AI has focused chiefly on the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulation of the former is an AI system the wire intolled AI systems and siculation AI systems and the scene is alo of the simulation of the simulat\n",
            "\n",
            "Epoch: 47 | Loss: 5.72746\n",
            "Artificial intelligence mithes in the scene AI sen experience computer ste und the scene AI services. In experience with simult on the hardert of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of t\n",
            "Research in AI has focused chiefly onten and selvion AI.\n",
            "Problems the envire munt of in the scene AI sen experience computer ste und the scene AI services. In experience with simult on the hardert of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation of the simulation \n",
            "\n",
            "Epoch: 48 | Loss: 4.98791\n",
            "Artificial intelligence to the carticular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human i\n",
            "Research in AI has focused chiefly on the former is in either the program that con the simulat ob the food is displaced. Tnitions of inputs to verh concest of inputs to reason with similar verbs.\n",
            "on in AI is forment in platforms huse are task on indinution involves acce to the carticular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture human intelligence to the particular task or in the stel, reterst on the simulat ob the food is displaced. Tniture huma\n",
            "\n",
            "Epoch: 49 | Loss: 2.99209\n",
            "Artificial intelligence to handle tasks such as object manipulation of the particular task or situation. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memo\n",
            "Research in AI has focused chiefly on the former is, strefuct be inselligence processes include learning is also a core part of AI a system whar datheare or indrventing inforiag new rele analy of the food is displaced. Intelligence to handle tasks such as object manipulation of the particular task or situation. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "e51niRQbF0AL",
        "colab_type": "code",
        "outputId": "f3cba66f-04af-41e6-ae70-1e9efe92c7eb",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 281
        }
      },
      "source": [
        "import matplotlib.pyplot as plt\n",
        "\n",
        "plt.plot(losses, c = 'r')\n",
        "plt.title('Training Loss')\n",
        "plt.show()"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "display_data",
          "data": {
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXQAAAEICAYAAABPgw/pAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4zLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvnQurowAAIABJREFUeJzt3Xu8TXX+x/HXx5GhIuSQolzCRGOU\nQ/mRkdRECuWHbj8adfIoTRfdm+bXvaYpTaZJKWb6TblUCkUXKankcpQwqciULgqNysw0Fb6/Pz7L\nOBmc45y999p77ffz8diPs/faa1ufNXN6W777uz5fCyEgIiK5r0rcBYiISGoo0EVEEkKBLiKSEAp0\nEZGEUKCLiCSEAl1EJCEU6JKTzKzAzP5uZgemcl+RXGaahy6ZYGZ/L/VyT+BbYHP0+twQwiOZr6ry\nzOwmoFEIYUjctYhUjbsAyQ8hhL23PjezD4CzQwgv7Gx/M6saQtiUidpEkkJDLpIVzOwmM5tkZhPM\nbCNwhpl1MrN5Zvalma0xs1Fmtke0f1UzC2bWJHr9cPT+M2a20cxeN7Omu7tv9H5PM3vPzL4ys9+b\n2WtmNqQC59TGzF6O6l9qZieUeq+3mS2Pjv+xmV0cba9vZjOiz/zNzOZU9H9TyT8KdMkm/YDxwD7A\nJGATcCFQD+gMHA+cu4vPnwZcC9QFVgM37u6+ZlYfeBS4LDruX4GOu3siZlYNeBqYDhQCFwOTzOzg\naJc/AkNDCDWBtsDL0fbLgFXRZ/YDfrW7x5b8pUCXbPJqCOGpEMKWEMI3IYSFIYT5IYRNIYRVwBjg\nZ7v4/OMhhJIQwvfAI0C7CuzbG1gcQpgavXcXsL4C59IZqAb8NoTwfTS89AwwKHr/e6C1mdUMIfwt\nhPBGqe37AweGEL4LIegKXcpNgS7Z5KPSL8zsx2Y23cw+M7OvgRvwq+ad+azU838Ce+9sx13su3/p\nOoLPGvi4HLVvb39gdfjhrIMPgQOi5/2Ak4DVZjbbzI6Itt8W7TfLzN43s8sqcGzJUwp0ySbbT7m6\nH1gGHBxCqAX8GrA017AGaLT1hZkZ20J4d3wKNI4+v9WBwCcA0b88TgLq40MzE6PtX4cQLg4hNAH6\nAleY2a7+VSLybwp0yWY1ga+Af5jZIex6/DxVngYON7MTzawqPoZfWMZnCsyseqnHj4C5+HcAI8xs\nDzPrDvTCx9FrmNlpZlYrGtbZCGwBiI7bPPqL4Ct8aueW9JyqJI0CXbLZCGAwHnj341+UplUI4XNg\nIDAS+AJoDryJz5vfmTOAb0o93g0hfAucCPTBx+BHAaeFEFZEnxkMfBgNJQ2N/gyAVsCLwN+B14C7\nQwivpOwEJdF0Y5HILphZAT580l/BKtlOV+gi2zGz482sdjR0ci0+82RBzGWJlEmBLvKfuuBzwdcB\nPwf6RUMoIllNQy4iIgmhK3QRkYTIaHOuevXqhSZNmmTykCIiOW/RokXrQwhlTZ/NbKA3adKEkpKS\nTB5SRCTnmdmH5dlPQy4iIgmhQBcRSYgyA93MGpvZS2b2tpn9xcwujLZfZ2afmNni6NEr/eWKiMjO\nlGcMfRMwIoTwhpnVBBaZ2czovbtCCHekrzwRESmvMgM9hLAG70BHCGGjmS2nYt3nREQkjXZrDD1a\nwuswYH60abiZLTGzcWZWZyefKTazEjMrWbduXaWKFRGRnSt3oJvZ3sBk4KIQwtfAaLwTXTv8Cv7O\nHX0uhDAmhFAUQigqLCxzGqWIiFRQuQI9Wph3MvBICOEJ8DajIYTNIYQtwANUYN3FcpsxA+66C1at\nStshRERyXXlmuRgwFlgeQhhZanvDUrv1w1eWSY8ZM+CSS6B5c2jbFq69FkpKQH1oRET+rczmXGbW\nBXgFWMq2lVOuBk7Fh1sC8AFwbvQF6k4VFRWFCt8pumoVTJ3qj1degS1b4IADoE8f+O//hqOOgoKC\niv3ZIiJZzMwWhRCKytwvk90WKxXopa1fD9One7g/9xz885/QsCH07w8DB0KnTlBF90yJSDKUN9Bz\nM/Xq1YPBg+GJJ2DtWpg40UN8zBjo0gWaNIFLLwXNqhGRPJKbgV7aXnv5VfnkyR7gDz8M7drBqFHQ\noQMsXhx3hSIiGZH7gV5azZpw+ukwbRrMnQubN8N//RdMSvvawiIisUtWoJdWVAQLF8Lhh8OgQXD1\n1R7wIiIJldxAB9hvP3jxRSguhltvhZNOgq++irsqEZG0SHagA1SrBvffD6NHw/PPQ8eOsHJl3FWJ\niKRc8gN9q2HDYNYs/+J02LC4qxERSbn8CXSArl3hV7/yYH/11birERFJqfwKdPCr8/r14frr465E\nRCSl8i/Q99wTLr8cXnjBpzaKiCRE/gU6+FV6YaGu0kUkUfIz0PfaCy67zGe9vP563NWIiKREfgY6\nwHnneU8YXaWLSELkb6BvvUp/7jmYNy/uakREKi1/Ax10lS4iiZLfgb733jBiBDz7LCxYEHc1IiKV\nkt+BDnD++bDvvrpKF5Gcp0CvWdOv0mfM8O6MIiI5SoEOMHw41K3rLXa18LSI5CgFOvhV+vXX+92j\nY8fGXY2ISIUo0Lc67zzo1g0uuQQ+/DDuakREdpsCfasqVWDcOB9yGToUtmyJuyIRkd2iQC+taVO4\n4w5vr3v//XFXIyKyWxTo2ysuhuOO87tIV62KuxoRkXJToG/PDB58EAoK4KyzNPQiIjlDgb4jjRvD\n734Hc+bA738fdzUiIuWiQN+ZIUOgd2+46ip47724qxERKZMCfWfMYMwYqF4dzjwTvvoq7opERHZJ\ngb4rDRv6VMY33oAuXWD16rgrEhHZKQV6Wfr29W6MH30ERxwBJSVxVyQiskMK9PI45hhfULp6deja\nFaZMibsiEZH/oEAvr9atfWWjtm3h5JNh5Eg18hKRrKJA3x0NGsBLL0H//t5y9/zzYdOmuKsSEQGg\natwF5JwaNWDiRGjWDH7zG3j/fZg0CWrXjrsyEclzukKviCpV4LbbfAbMSy9Bp06wcmXcVYlInlOg\nV8ZZZ3kP9XXrfAbMyy/HXZGI5DEFemV17Qrz5/v4eo8eWiBDRGJTZqCbWWMze8nM3jazv5jZhdH2\numY208xWRD/rpL/cLNW8Obz+OnTvDmefDZdeCps3x12ViOSZ8lyhbwJGhBBaA0cC55tZa+BKYFYI\noQUwK3qdv/bZB6ZP9/VJ77wTjjxSi06LSEaVGeghhDUhhDei5xuB5cABQB/goWi3h4C+6SoyZ1St\n6t0ZJ06Ejz/2cfXzzoMNG+KuTETywG6NoZtZE+AwYD7QIISwJnrrM6DBTj5TbGYlZlaybt26SpSa\nQwYOhHfegV/+0lc+atUK/u//dCOSiKRVuQPdzPYGJgMXhRC+Lv1eCCEAO0yrEMKYEEJRCKGosLCw\nUsXmlH328Z7qixb5GPvgwb4ItXrBiEialCvQzWwPPMwfCSE8EW3+3MwaRu83BNamp8Qc164dvPaa\nt+Jdtgw6dPCZMU8+qS9ORSSlyjPLxYCxwPIQwshSb00DBkfPBwNTU19eQlSpAuec42uUjhzpnRtP\nPhlatoS774aNG+OuUEQSoDxX6J2BM4HuZrY4evQCbgOONbMVQI/otezKPvvAxRfDihXw+OPeb/2i\ni6BRI5/q+MkncVcoIjnMQga/qCsqKgolGkP+oYUL4a674NFHfWHqwYPh8svh4IPjrkxEsoSZLQoh\nFJW1n+4UjVuHDjB+vF+1Dx3qs2FatYJBg2Dx4rirE5EcokDPFk2bwr33wgcf+PDLjBlw2GHQqxfM\nnq0pjyJSJgV6ttlvP2/Lu3o13HSTT3M8+mjo2NGHZdR/XUR2QoGerWrXhmuugQ8/hPvug6++8huW\nWraEe+6Bf/wj7gpFJMso0LNdjRpw7rmwfDk88YRfwV9wARx0ENxxB/zrX3FXKCJZQoGeKwoKoF8/\nX6z61VehqAguu2xbWwHdpCSS9xTouahzZ3j2WZg1CwoLfarj4Yf7Nn15KpK3FOi5rHt3WLAAJkzw\nu0179vRFNjTdUSQvKdBzXZUqPmf9nXe8jcBbb0H79t6XXW17RfKKAj0pqlXzdr0rVngP9tGjfUbM\n2LGwZUvc1YlIBijQk6ZOHV9kY9Ei/8L07LO1epJInlCgJ1W7dvDKK/DnP3t3xyOOgGHDNAwjkmAK\n9CQzgzPOgHff9a6ODzwAhxwCkyZpNoxIAinQ80GtWt6HfeFCb9U7aBCccIL3jRGRxFCg55PDD4f5\n831pvDlzoE0bv9tU/WFEEkGBnm8KCuDCC72VQI8efrdpUZEvkyciOU2Bnq8aN4YpU2DyZPjiC+jS\nBc46C9ZqaViRXKVAz2dmvrbpO+/AlVfCI49s6+aoYRiRnKNAF9hrL7j1Vli61FdQuuAC/zl3btyV\nichuUKDLNq1awfPPw2OPwfr13gTsf/4HPv007spEpBwU6PJDZtC/v39pevXVPme9ZUu/glfvdZGs\npkCXHdt7b7j5Zg/2Y4/1cG/Txr9I1U1JIllJgS671qwZPPkkzJwJ1av7IhvHHedBLyJZRYEu5dOj\nh7fmHTXKF65u29bnsG/cGHdlIhJRoEv5Va3qM2Dee89XSbrjDv8idfx4DcOIZAEFuuy+wkJ48EFv\nI3DAAXD66dCtm097FJHYKNCl4jp2hHnz4P77YdkyOOwwuPhiDcOIxESBLpVTUADFxT4Mc/bZvgze\nj3/sc9k1DCOSUQp0SY1994X77oPXX4f69WHAAF+0euXKuCsTyRsKdEmtI47wvut33+2tAw49FK6/\nXjcliWSAAl1Sr2pVX7D6nXegb1+47jq/KWnyZA3DiKSRAl3SZ//9YeJEvylpzz29pUC3br6AtYik\nnAJd0q9HD3jzTR9jX77cF9QYPBg++STuykQSRYEumVG1Kpx7rn9JesUVfuXesiX8+tewYUPc1Ykk\nggJdMqtWLbjtNh9f790bbrwRDjrIF9jQakkilaJAl3g0beqteZcsgRNOgNtvhyZNfL3Tjz+OuzqR\nnFRmoJvZODNba2bLSm27zsw+MbPF0aNXesuUxPrJT2DCBL9iHzQI7r3XOzwWF8MHH8RdnUhOKc8V\n+p+A43ew/a4QQrvoMSO1ZUneadkSxo3zMfZzzoGHHvJtw4bBRx/FXZ1ITigz0EMIc4C/ZaAWER9P\n/8Mf4P33PdjHjYODD4bhwzUrRqQMlRlDH25mS6IhmTo728nMis2sxMxK1q1bV4nDSV5p1MiDfeVK\nGDLEG4A1b+5j7LpiF9mhigb6aKA50A5YA9y5sx1DCGNCCEUhhKLCwsIKHk7y1oEHepi/95636f3D\nH3yM/fTTdYOSyHYqFOghhM9DCJtDCFuAB4COqS1LZDtNm8LYsX7FfsEF8NRTfoNSt24wbRps2RJ3\nhSKxq1Cgm1nDUi/7Act2tq9ISjVpAiNH+rDLHXfAqlXQp4+37J06Ne7qRGJVnmmLE4DXgVZm9rGZ\nDQVuN7OlZrYEOBq4OM11ivzQPvvAiBH+5emECVCjhjcCu+QS+O67uKsTiYWFDHa/KyoqCiUlJRk7\nnuSR777zRatHjfIWvo8+6uPvIglgZotCCEVl7ac7RSUZqlXzHuyPPQZvv+3L4U2fHndVIhmlQJdk\n6d/fZ780buy9Yq66CjZtirsqkYxQoEvytGjhS+Gdc443AuvcGebPj7sqkbRToEsy1agBY8bA+PGw\nejUceSSceabuNpVEU6BLsp16qt+UdNVVPr7esqW37P3mm7grE0k5BbokX82acMstvlpSr16+qEar\nVj4TRmucSoIo0CV/NG3qV+mzZ8O++8LAgX5T0qefxl2ZSEoo0CX//OxnUFICd97pC1i3aePtenW1\nLjlOgS75qaDA7ypdssQX2RgyxFdO0mpJksMU6JLfWrTwIZhRo+Dll/1qfcwYzV2XnKRAF6lSxTs4\nLl0K7dvDued6i95bbtHC1ZJTFOgiWzVrBi+8AE8+6bNgrrnG7zg980yYN09j7JL1FOgipVWp4l0b\nZ870aY7nnutteTt1gg4d/Kp97lx1dJSspG6LImXZuBEefhgeeADefNO37bmntxTo1s0fHTtC1apx\nVikJVt5uiwp0kd2xfj3MmeNfpM6e7ePu4K16L78cfvELbzsgkkJqnyuSDvXqwckn+6yYJUtg3TqY\nNMkXtR4+3FdU+s1v4Ouv465U8pACXaQy6tWDAQPg1Vf9ir1dO7jySjjoIG8xsH593BVKHlGgi6SC\nmd+B+txzsGABHH20NwFr3hx++1v49tu4K5Q8oEAXSbUOHeCJJ2DZMjjqKB9bb90aJk/W1EdJKwW6\nSLq0aQNPP+1X7TVq+GpK3brBG2/EXZkklAJdJN2OOw4WL4bRo32906IiGDQI7r0XXnvNp0WKpICm\nLYpk0pdfws03w9ixsGHDtu3NmsFPf+phP3w41KoVX42SdTQPXSSbheCdHd9664ePFSvg0ENh+nRv\nOyBC+QNdt7aJxMHMA7txY+jde9v2mTN9rP2II+Cpp7xZmEg5aQxdJJsce6z3itljD+jaFaZN2/m+\nGzZ4O4JXX81cfZLVFOgi2aZNG5g/36c69u0Ld9+9bbrjli3eEfK006BhQygu9nVSV6yIt2bJChpy\nEclG++3nC26ccQZcdBG8+y40aAB//CN8+CHUqQPnnOOrLJ1+ug/TzJunPjJ5ToEukq323NMXtb7i\nCl//1Ax69IDbbvMr9+rVfb+HH/ar9OHDffaM5C0Fukg2KyiAO+6AgQOhfn3vEbO9nj3hV7+Cm27y\nO1OHDMl4mZIdNIYukgs6dNhxmG913XXQvTucd962lr6SdxToIklQUADjx0Pt2nDKKWrfm6cU6CJJ\n0aABTJwIq1bB2WerEVgeUqCLJEnXrt5a4LHH4J574q5GMkyBLpI0l10GJ54IF1/snR4lbyjQRZKm\nShWfynjooT4/fevC1pJ4CnSRJKpVC2bM8BuQevXym5Ek8RToIkm1//7wzDPwzTc+V710u15JpDID\n3czGmdlaM1tWaltdM5tpZiuin3XSW6aIVEibNjBlCrz/PvTrp7VNE648V+h/Ao7fbtuVwKwQQgtg\nVvRaRLJRt27wpz95b5ghQ7zBlyRSmbf+hxDmmFmT7Tb3AbpFzx8CZgNXpLAuEUmlU0+F1avhyiuh\nXj0YOtTvPK1d23vESCJUtJdLgxDCmuj5Z0CDne1oZsVAMcCBBx5YwcOJSKVdfrmH+j33bJujXrOm\nB/tBB0GTJr4MXvv2PkOmWrVYy5XdV64l6KIr9KdDCIdGr78MIdQu9f6GEEKZ4+hagk4kZiH4NMZV\nq3zmS+nHX/+6rWVAtWrQtq2He/v23k6gbt14a89j6V6C7nMzaxhCWGNmDYG1FfxzRCSTzODww/2x\nvRA86BctgpIS/zlxItx/P9x6Kzz9tC+6IVmrotMWpwGDo+eDgampKUdEYmMGzZvDgAFw++0wa5ZP\ndZwzB/75T+jUSXeeZrnyTFucALwOtDKzj81sKHAbcKyZrQB6RK9FJGnMvMf6woXQtKnfpKQeMVmr\nPLNcTt3JW8ekuBYRyVaNG/ti1KefDhdcAMuX+1qnVbVGTjbRnaIiUj577w1PPOHNv+6916/Wv/wy\n7qqkFAW6iJRfQYGPr48bB7Nne3uB44/3NU+XLIm/B/vq1d6YLE8p0EVk9511Frz+OpxzjofopZf6\nHPb994czz4Snnoqnrhtu8ON/8EE8x4+ZAl1EKqZ9ex9Hf/tt+Ogjv2o/+mh49lk46SS49trMXrFv\n3gzTpvnzZ57J3HGziAJdRCqvUSO/ah8/Htas8dYCN93kS+Ft2pSZGubNg3Xr/HmeBrq+ohaR1Kpa\nFR54wIdfbrwR1q6FSZNgzz3Te9wpU2CPPWDgQP/y9l//gurV03vMLKMrdBFJPTMfzx492hfaOOYY\nWL8+fccLwQO9e3cYNMhvhHrllfQdL0sp0EUkfYYNg8cf9/4xnTun78vK5cth5Uro29fH8X/0o7wc\ndtGQi4ikV79+8MILvnB1+/Zw5JF+12mzZv5z6/NatSp+jKlR95GTTvKhnW7d/F8GI0em5BRyha7Q\nRST9unTxO02POQY+/RT+/GcYMQJOPhkOO8z7so8YUfEvUKdMgY4dfdwefMm9d9/1ZmN5RIEuIpnR\npg08+qgPv3z5JXzxhXd1fOwxnyEzciQce6x/ibo7Pv0UFiyAPn22bevVy3/m2bCLAl1EMs/M+6u3\nbw/9+8PYsb5M3rx5vm3BgvL/WVvnnvftu21bixbeOVKBLiISg8GDYe5cn/Z41FHw4IPl+9zUqXDw\nwXDIIT/c3rMnvPiiT1/MEwp0Eckehx3mwzDdunlbgeJi+Pbbne//9dfet71v3/9cG7VXL/jmG18c\nO08o0EUku+y7r89Queoqv0Gpf3+/rX9Hnn0Wvv/+h+PnW3Xr5jcW5dGwiwJdRLJPQQHccgv8/ve+\n9N211+54vylToLDQV1PaXo0aPid9xoz01ppFFOgikr3OP9+HXm69FSZM+OF7333nYX3iif4XwI70\n7AkrVsD776e/1iygQBeR7GXmS9516QK/+IUvXL3Vyy/DV1/9cHbL9nr29J95MuyiQBeR7FatGkye\nDPXre3h/9plvnzrV7wrt0WPnnz34YJ/CmCfDLgp0Ecl+9et7gH/xBZxyik9FnDoVfv5zHyvflZ49\n4aWXfMZLwinQRSQ3tGvnNx/NnevL3n388a6HW7bq1cv/Apg9O90Vxk6BLiK5Y8AAuOYaHz8vKIAT\nTij7Mz/7mV/F58E4urotikhuueEG799i5nPWy1K9uvdJV6CLiGSZKlV8/dLd0bMnTJ/urXqrVPG/\nDLY+fvQjuP567/yY4xToIpJ8p50GS5f6SkYh/PCxdCmceqpfwXfvHnellaJAF5Hkq1MH7rtvx+9t\n2ABdu/oXrHPm+JevOUpfiopIfqtTx6/Oa9f2oZl0LZOXAQp0EZFGjbzR17ff+tz2devirqhCFOgi\nIgCtW8NTT8Hq1dC7N/zjH3FXtNsU6CIiW3XuDBMnek/2AQO8NW8OUaCLiJTWpw+MHu39Xzp18ha+\nW/vHZDkFuojI9oqLfa7799/DL38JBxzgTcDGjvVZMVlKgS4isiNnnQVvvQV/+QtcfbXPfjn7bGjQ\nwHu0b9oUd4X/QYEuIrIrrVvDjTf6QhkLF8LQob6AdXGx35iURXRjkYhIeZhBUZE/GjTwdgH16sHt\nt8dd2b8p0EVEdtf//i+sXw+//a2H+uWXx10RUMlAN7MPgI3AZmBTCKEoFUWJiGQ1Mxg1yhfcuOIK\n7/o4dGjcVaXkCv3oEML6FPw5IiK5o0oVeOghn/VSXAx160K/fvGWFOvRRURy2db1Tjt2hEGDfKm7\nGFU20APwvJktMrPiVBQkIpJT9trLe623aOEdG2Ocp17ZQO8SQjgc6Amcb2Zdt9/BzIrNrMTMStbl\naMMbEZFdqlvXb0T6+mt48snYyqhUoIcQPol+rgWeBDruYJ8xIYSiEEJRYWFhZQ4nIpK9OnSAZs1g\n0qTYSqhwoJvZXmZWc+tz4DhgWaoKExHJKWYwcCDMmhVb+93KXKE3AF41s7eABcD0EMKzqSlLRCQH\nDRwImzf7F6UxqPC0xRDCKuCnKaxFRCS3tW0LrVr5sMuwYRk/vKYtioikiplPX3z5Zfj004wfXoEu\nIpJKAwd6067HH8/4oRXoIiKpdMgh8JOfxDLbRYEuIpJqgwbB3Lm+PmkGKdBFRFJt4ED/+eijGT2s\nAl1EJNWaN4f27TM+7KJAFxFJh0GDoKQEVq7M2CEV6CIi6TBggP/M4LCLAl1EJB0OPBA6dcrosIsC\nXUQkXQYNgiVLYPnyjBxOgS4iki79+/vdoxm6Slegi4iky/77Q9euHughpP1wCnQRkXQaNAjeeceH\nXtJMgS4ikk6nnALHHw/ff5/2Q1W4fa6IiJRDYSE880xGDqUrdBGRhFCgi4gkhAJdRCQhFOgiIgmh\nQBcRSQgFuohIQijQRUQSQoEuIpIQFjLQX+DfBzNbB3xYwY/XA9ansJxcofPOP/l67jrvnTsohFBY\n1h+U0UCvDDMrCSEUxV1Hpum880++nrvOu/I05CIikhAKdBGRhMilQB8TdwEx0Xnnn3w9d513JeXM\nGLqIiOxaLl2hi4jILijQRUQSIicC3cyON7N3zWylmV0Zdz3pYmbjzGytmS0rta2umc00sxXRzzpx\n1pgOZtbYzF4ys7fN7C9mdmG0PdHnbmbVzWyBmb0Vnff10famZjY/+n2fZGbV4q41HcyswMzeNLOn\no9eJP28z+8DMlprZYjMribal7Pc86wPdzAqAPwA9gdbAqWbWOt6q0uZPwPHbbbsSmBVCaAHMil4n\nzSZgRAihNXAkcH70/3HSz/1boHsI4adAO+B4MzsS+A1wVwjhYGADMDTGGtPpQmB5qdf5ct5HhxDa\nlZp7nrLf86wPdKAjsDKEsCqE8B0wEegTc01pEUKYA/xtu819gIei5w8BfTNaVAaEENaEEN6Inm/E\n/yM/gISfe3B/j17uET0C0B14PNqeuPMGMLNGwAnAg9FrIw/OeydS9nueC4F+APBRqdcfR9vyRYMQ\nwpro+WdAgziLSTczawIcBswnD849GnZYDKwFZgLvA1+GEDZFuyT19/13wOXAluj1vuTHeQfgeTNb\nZGbF0baU/Z5rkegcEkIIZpbYeaZmtjcwGbgohPC1X7S5pJ57CGEz0M7MagNPAj+OuaS0M7PewNoQ\nwiIz6xZ3PRnWJYTwiZnVB2aa2Tul36zs73kuXKF/AjQu9bpRtC1ffG5mDQGin2tjrictzGwPPMwf\nCSE8EW3Oi3MHCCF8CbwEdAJqm9nWi60k/r53Bk4ysw/wIdTuwN0k/7wJIXwS/VyL/wXekRT+nudC\noC8EWkTfgFcDBgHTYq4pk6YBg6Png4GpMdaSFtH46VhgeQhhZKm3En3uZlYYXZljZjWAY/HvD14C\n+ke7Je68QwhXhRAahRCa4P89vxhCOJ2En7eZ7WVmNbc+B44DlpHC3/OcuFPUzHrhY24FwLgQws0x\nl5QWZjYB6Ia30/wc+F9gCvAocCDeenhACGH7L05zmpl1AV4BlrJtTPVqfBw9seduZm3xL8EK8Iur\nR0MIN5hZM/zKtS7wJnBGCOGlgUjKAAAAVUlEQVTb+CpNn2jI5dIQQu+kn3d0fk9GL6sC40MIN5vZ\nvqTo9zwnAl1ERMqWC0MuIiJSDgp0EZGEUKCLiCSEAl1EJCEU6CIiCaFAFxFJCAW6iEhC/D9WPefy\nEmD+PwAAAABJRU5ErkJggg==\n",
            "text/plain": [
              "<Figure size 432x288 with 1 Axes>"
            ]
          },
          "metadata": {
            "tags": []
          }
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "de5IzlVP6N0Y",
        "colab_type": "text"
      },
      "source": [
        "##Lets generate more paragraphs"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "TKQARfmZ6TeT",
        "colab_type": "code",
        "outputId": "3c006f6e-3353-4cff-b8d4-a0f58384c615",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 70
        }
      },
      "source": [
        "print(generate(\"Machines can often act and react like\", num_chars = 500))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Machines can often act and react like human fiex rele and relations between all of them to implement knowledge engineering. Initiating complex tasks—as, for example, discovering proofs for as applying past experiment with similar verbs.\n",
            "on intelligence with intelligent as applied to the problem of implement and react like human fiel her burrow which AI selvice as dith the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "caM4rJ-w6TbN",
        "colab_type": "code",
        "outputId": "e5c8eaa8-9723-4a05-8ae9-5f937e73cb35",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 54
        }
      },
      "source": [
        "print(generate(\"There are a number of different forms of learning\", num_chars = 500))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "There are a number of different forms of learning as applicable to the problem of implement and react like human fiel her burrow which AI selvice as dith the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. This is also a madical complite the case the the simple memorision involves able to generalize can learn the case the trulise probled is including AI components in AI is means—on is to displace the past tense of the former is and reans—ing involves drawing inferences relevant to the solution. T\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "H4eFTYaU7IEC",
        "colab_type": "code",
        "outputId": "36e761c2-27ff-43dc-fdb8-8a7db1aac519",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 54
        }
      },
      "source": [
        "print(generate(\"Problem solving, particularly in artificial intelligence, may be characterized as\", num_chars = 250))"
      ],
      "execution_count": 0,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Problem solving, particularly in artificial intelligence, may be characterized as a system that computers that can be crobledge endines and mapping AI complicated by the form is moved a few in mathematics and relations between all of them to implement knowledge engineering. Initiating complex tasks—as, for example, discovering pr\n"
          ],
          "name": "stdout"
        }
      ]
    }
  ]
}