NeuralNetwork_from_Scratch_ipynb_.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "NeuralNetwork_from_Scratch.ipynb_",
      "provenance": [],
      "collapsed_sections": [],
      "mount_file_id": "1W-4snw3DR9c1SKuvMX5tFXAK_32L7STH",
      "authorship_tag": "ABX9TyMtslp9rkmI5OZaAt2oTFI4",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/vernikagupta/Deep_Learning_with_Maths/blob/master/NeuralNetwork_from_Scratch_ipynb_.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "m_lMdNiclsNR",
        "colab_type": "text"
      },
      "source": [
        "**The Network architecture is**\n",
        "\n",
        "##### 3 neurons in input layer plus one bias\n",
        "##### 4 neurons in hidden layer plus one bias\n",
        "##### 1 neuron in output layer\n",
        "##### cost function is (target - output)<sup>2</sup>\n",
        "##### activation function Sigmoid"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "IciaWyqg9E_o",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "import numpy as np"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "7Ga-M5V69HFX",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def Sigmoid(x):\n",
        "  out = 1.0/(1+np.exp(-x))\n",
        "  return out"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "bo5LrmJZ9P6A",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "def Sigmoid_derivative(x):\n",
        "  return x * (1.0-x)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "SWWrGegv1zul",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        "class NN():\n",
        "  def __init__(self, input, target ):\n",
        "    self.input = input   # input data\n",
        "    self.target = target   # labels initialization\n",
        "    self.bias1 = np.random.rand(1)\n",
        "    self.bias2 = np.random.rand(1)\n",
        "    self.weights1 = np.random.rand(self.input.shape[1],4) # initialize weights for hidden layers\n",
        "    #self.weights1 = np.zeros((self.input.shape[1],4))  # use this if wants to check effect of zero initialization\n",
        "    self.weights2 = np.random.rand(4,1)  # initialize weights for output layer\n",
        "    #self.weights2 = np.zeros((4,1))  \n",
        "    self.output = np.zeros(self.target.shape)    # initialize output with zeros\n",
        "\n",
        "  def feedForward(self):\n",
        "    self.layer1 = Sigmoid(np.dot(self.input, self.weights1) + self.bias1)\n",
        "    self.output = Sigmoid(np.dot(self.layer1, self.weights2) + self.bias2)\n",
        "    cost = 2*np.sum((self.target - self.output))\n",
        "    return (self.output, cost)\n",
        "\n",
        "  def backpropagation(self):\n",
        "    # chain rule to calculate derivative of cost function with weights\n",
        "    cost_act_mul = (2*(self.target-self.output)) * Sigmoid_derivative(self.output)\n",
        "    d_weights2 = np.dot(self.layer1.T, cost_act_mul)\n",
        "    #print(d_weights2.shape)\n",
        "    d_weights1 = np.dot(self.input.T,  \n",
        "                        (np.dot(2*(self.target - self.output) * Sigmoid_derivative(self.output), self.weights2.T)\n",
        "                         * Sigmoid_derivative(self.layer1)))\n",
        "\n",
        "    # update the weights with the derivative (slope) of the loss function\n",
        "    print(\"weight1 before iteration:\\n\",self.weights1)\n",
        "   \n",
        "    self.weights1 += d_weights1\n",
        "    print(\"\\nweight1 after iteration:\\n\",self.weights1)\n",
        "    #print(d_weights2.shape)\n",
        "    print(\"\\nweight2 before iteration:\\n\",self.weights2)\n",
        "    self.weights2 += d_weights2\n",
        "    \n",
        "    \n",
        "    print(\"\\nweight2 after iteration:\\n\",self.weights2)\n",
        "    \n",
        "\n"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "UPqpJtzaD9G0",
        "colab_type": "code",
        "colab": {}
      },
      "source": [
        " x = np.array([[0,0,1],[0,1,1],[1,0,1],[1,1,1]])\n",
        " y = np.array([[0],[1],[1],[0]]) "
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "M4Z7uxwj4cCX",
        "colab_type": "code",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "3accdf47-a9fd-49f1-d341-bc508755f561"
      },
      "source": [
        "nn = NN(x,y)\n",
        "for i in range(1500):\n",
        "  print(\"i\",i)\n",
        "  output, cost = nn.feedForward()\n",
        "  nn.backpropagation()\n",
        "\n",
        "print(\"\\noutput\",output)\n",
        "print(\"\\n cost: \", cost)"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "\u001b[1;30;43mStreaming output truncated to the last 5000 lines.\u001b[0m\n",
            " [[ 5.9018265   2.25459418  5.88579309 -3.29015555]\n",
            " [ 5.96569015  1.61833898 -2.1304435   6.22709995]\n",
            " [-1.61226884 -3.08633902 -0.58498401  0.50336609]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90203454  2.2549175   5.88622172 -3.29045762]\n",
            " [ 5.96590839  1.6188718  -2.13073843  6.22748231]\n",
            " [-1.61233077 -3.08704868 -0.58490336  0.5034734 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.77751419]\n",
            " [-3.35795819]\n",
            " [-5.94693776]\n",
            " [-6.42060214]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.77864623]\n",
            " [-3.35871139]\n",
            " [-5.9475241 ]\n",
            " [-6.42110289]]\n",
            "i 1274\n",
            "weight1 before iteration:\n",
            " [[ 5.90203454  2.2549175   5.88622172 -3.29045762]\n",
            " [ 5.96590839  1.6188718  -2.13073843  6.22748231]\n",
            " [-1.61233077 -3.08704868 -0.58490336  0.5034734 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90224232  2.25524053  5.8866498  -3.29075931]\n",
            " [ 5.96612636  1.61940406 -2.13103301  6.22786418]\n",
            " [-1.61239264 -3.08775758 -0.58482278  0.50358058]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.77864623]\n",
            " [-3.35871139]\n",
            " [-5.9475241 ]\n",
            " [-6.42110289]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.77977701]\n",
            " [-3.35946391]\n",
            " [-5.94810972]\n",
            " [-6.421603  ]]\n",
            "i 1275\n",
            "weight1 before iteration:\n",
            " [[ 5.90224232  2.25524053  5.8866498  -3.29075931]\n",
            " [ 5.96612636  1.61940406 -2.13103301  6.22786418]\n",
            " [-1.61239264 -3.08775758 -0.58482278  0.50358058]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90244985  2.25556327  5.88707734 -3.29106063]\n",
            " [ 5.96634407  1.61993577 -2.13132725  6.22824555]\n",
            " [-1.61245444 -3.08846572 -0.58474226  0.50368765]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.77977701]\n",
            " [-3.35946391]\n",
            " [-5.94810972]\n",
            " [-6.421603  ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78090654]\n",
            " [-3.36021577]\n",
            " [-5.94869464]\n",
            " [-6.42210247]]\n",
            "i 1276\n",
            "weight1 before iteration:\n",
            " [[ 5.90244985  2.25556327  5.88707734 -3.29106063]\n",
            " [ 5.96634407  1.61993577 -2.13132725  6.22824555]\n",
            " [-1.61245444 -3.08846572 -0.58474226  0.50368765]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90265713  2.25588572  5.88750433 -3.29136158]\n",
            " [ 5.96656151  1.62046693 -2.13162114  6.22862642]\n",
            " [-1.61251618 -3.0891731  -0.5846618   0.50379459]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78090654]\n",
            " [-3.36021577]\n",
            " [-5.94869464]\n",
            " [-6.42210247]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78203482]\n",
            " [-3.36096696]\n",
            " [-5.94927885]\n",
            " [-6.4226013 ]]\n",
            "i 1277\n",
            "weight1 before iteration:\n",
            " [[ 5.90265713  2.25588572  5.88750433 -3.29136158]\n",
            " [ 5.96656151  1.62046693 -2.13162114  6.22862642]\n",
            " [-1.61251618 -3.0891731  -0.5846618   0.50379459]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90286415  2.25620788  5.88793077 -3.29166216]\n",
            " [ 5.96677869  1.62099753 -2.13191468  6.22900681]\n",
            " [-1.61257786 -3.08987972 -0.58458141  0.50390141]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78203482]\n",
            " [-3.36096696]\n",
            " [-5.94927885]\n",
            " [-6.4226013 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78316185]\n",
            " [-3.36171748]\n",
            " [-5.94986236]\n",
            " [-6.42309949]]\n",
            "i 1278\n",
            "weight1 before iteration:\n",
            " [[ 5.90286415  2.25620788  5.88793077 -3.29166216]\n",
            " [ 5.96677869  1.62099753 -2.13191468  6.22900681]\n",
            " [-1.61257786 -3.08987972 -0.58458141  0.50390141]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90307093  2.25652975  5.88835667 -3.29196237]\n",
            " [ 5.9669956   1.62152758 -2.13220788  6.2293867 ]\n",
            " [-1.61263948 -3.09058558 -0.58450108  0.50400812]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78316185]\n",
            " [-3.36171748]\n",
            " [-5.94986236]\n",
            " [-6.42309949]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78428764]\n",
            " [-3.36246734]\n",
            " [-5.95044517]\n",
            " [-6.42359705]]\n",
            "i 1279\n",
            "weight1 before iteration:\n",
            " [[ 5.90307093  2.25652975  5.88835667 -3.29196237]\n",
            " [ 5.9669956   1.62152758 -2.13220788  6.2293867 ]\n",
            " [-1.61263948 -3.09058558 -0.58450108  0.50400812]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90327745  2.25685133  5.88878203 -3.29226221]\n",
            " [ 5.96721225  1.62205709 -2.13250073  6.2297661 ]\n",
            " [-1.61270103 -3.09129068 -0.58442081  0.5041147 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78428764]\n",
            " [-3.36246734]\n",
            " [-5.95044517]\n",
            " [-6.42359705]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78541219]\n",
            " [-3.36321653]\n",
            " [-5.95102727]\n",
            " [-6.42409397]]\n",
            "i 1280\n",
            "weight1 before iteration:\n",
            " [[ 5.90327745  2.25685133  5.88878203 -3.29226221]\n",
            " [ 5.96721225  1.62205709 -2.13250073  6.2297661 ]\n",
            " [-1.61270103 -3.09129068 -0.58442081  0.5041147 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90348372  2.25717262  5.88920685 -3.29256168]\n",
            " [ 5.96742863  1.62258604 -2.13279324  6.23014502]\n",
            " [-1.61276253 -3.09199503 -0.58434061  0.50422116]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78541219]\n",
            " [-3.36321653]\n",
            " [-5.95102727]\n",
            " [-6.42409397]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78653549]\n",
            " [-3.36396505]\n",
            " [-5.95160868]\n",
            " [-6.42459026]]\n",
            "i 1281\n",
            "weight1 before iteration:\n",
            " [[ 5.90348372  2.25717262  5.88920685 -3.29256168]\n",
            " [ 5.96742863  1.62258604 -2.13279324  6.23014502]\n",
            " [-1.61276253 -3.09199503 -0.58434061  0.50422116]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90368974  2.25749362  5.88963113 -3.29286079]\n",
            " [ 5.96764475  1.62311445 -2.13308541  6.23052344]\n",
            " [-1.61282396 -3.09269863 -0.58426047  0.5043275 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78653549]\n",
            " [-3.36396505]\n",
            " [-5.95160868]\n",
            " [-6.42459026]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78765756]\n",
            " [-3.36471292]\n",
            " [-5.95218939]\n",
            " [-6.42508591]]\n",
            "i 1282\n",
            "weight1 before iteration:\n",
            " [[ 5.90368974  2.25749362  5.88963113 -3.29286079]\n",
            " [ 5.96764475  1.62311445 -2.13308541  6.23052344]\n",
            " [-1.61282396 -3.09269863 -0.58426047  0.5043275 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90389551  2.25781434  5.89005487 -3.29315953]\n",
            " [ 5.96786062  1.6236423  -2.13337724  6.23090138]\n",
            " [-1.61288533 -3.09340147 -0.5841804   0.50443373]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78765756]\n",
            " [-3.36471292]\n",
            " [-5.95218939]\n",
            " [-6.42508591]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.78877839]\n",
            " [-3.36546012]\n",
            " [-5.9527694 ]\n",
            " [-6.42558094]]\n",
            "i 1283\n",
            "weight1 before iteration:\n",
            " [[ 5.90389551  2.25781434  5.89005487 -3.29315953]\n",
            " [ 5.96786062  1.6236423  -2.13337724  6.23090138]\n",
            " [-1.61288533 -3.09340147 -0.5841804   0.50443373]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90410103  2.25813477  5.89047807 -3.2934579 ]\n",
            " [ 5.96807622  1.62416962 -2.13366872  6.23127883]\n",
            " [-1.61294664 -3.09410356 -0.58410039  0.50453983]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.78877839]\n",
            " [-3.36546012]\n",
            " [-5.9527694 ]\n",
            " [-6.42558094]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.789898  ]\n",
            " [-3.36620667]\n",
            " [-5.95334871]\n",
            " [-6.42607533]]\n",
            "i 1284\n",
            "weight1 before iteration:\n",
            " [[ 5.90410103  2.25813477  5.89047807 -3.2934579 ]\n",
            " [ 5.96807622  1.62416962 -2.13366872  6.23127883]\n",
            " [-1.61294664 -3.09410356 -0.58410039  0.50453983]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9043063   2.25845492  5.89090073 -3.29375591]\n",
            " [ 5.96829156  1.62469639 -2.13395987  6.2316558 ]\n",
            " [-1.61300788 -3.09480491 -0.58402044  0.50464582]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.789898  ]\n",
            " [-3.36620667]\n",
            " [-5.95334871]\n",
            " [-6.42607533]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79101637]\n",
            " [-3.36695255]\n",
            " [-5.95392733]\n",
            " [-6.4265691 ]]\n",
            "i 1285\n",
            "weight1 before iteration:\n",
            " [[ 5.9043063   2.25845492  5.89090073 -3.29375591]\n",
            " [ 5.96829156  1.62469639 -2.13395987  6.2316558 ]\n",
            " [-1.61300788 -3.09480491 -0.58402044  0.50464582]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90451133  2.25877478  5.89132286 -3.29405355]\n",
            " [ 5.96850663  1.62522261 -2.13425067  6.23203228]\n",
            " [-1.61306907 -3.09550551 -0.58394055  0.50475168]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79101637]\n",
            " [-3.36695255]\n",
            " [-5.95392733]\n",
            " [-6.4265691 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79213351]\n",
            " [-3.36769777]\n",
            " [-5.95450526]\n",
            " [-6.42706225]]\n",
            "i 1286\n",
            "weight1 before iteration:\n",
            " [[ 5.90451133  2.25877478  5.89132286 -3.29405355]\n",
            " [ 5.96850663  1.62522261 -2.13425067  6.23203228]\n",
            " [-1.61306907 -3.09550551 -0.58394055  0.50475168]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9047161   2.25909435  5.89174446 -3.29435084]\n",
            " [ 5.96872145  1.62574829 -2.13454114  6.23240828]\n",
            " [-1.61313019 -3.09620536 -0.58386073  0.50485743]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79213351]\n",
            " [-3.36769777]\n",
            " [-5.95450526]\n",
            " [-6.42706225]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79324944]\n",
            " [-3.36844234]\n",
            " [-5.9550825 ]\n",
            " [-6.42755476]]\n",
            "i 1287\n",
            "weight1 before iteration:\n",
            " [[ 5.9047161   2.25909435  5.89174446 -3.29435084]\n",
            " [ 5.96872145  1.62574829 -2.13454114  6.23240828]\n",
            " [-1.61313019 -3.09620536 -0.58386073  0.50485743]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90492063  2.25941364  5.89216552 -3.29464775]\n",
            " [ 5.96893602  1.62627343 -2.13483127  6.2327838 ]\n",
            " [-1.61319125 -3.09690446 -0.58378097  0.50496306]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79324944]\n",
            " [-3.36844234]\n",
            " [-5.9550825 ]\n",
            " [-6.42755476]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79436413]\n",
            " [-3.36918626]\n",
            " [-5.95565905]\n",
            " [-6.42804666]]\n",
            "i 1288\n",
            "weight1 before iteration:\n",
            " [[ 5.90492063  2.25941364  5.89216552 -3.29464775]\n",
            " [ 5.96893602  1.62627343 -2.13483127  6.2327838 ]\n",
            " [-1.61319125 -3.09690446 -0.58378097  0.50496306]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90512492  2.25973265  5.89258606 -3.29494431]\n",
            " [ 5.96915032  1.62679803 -2.13512106  6.23315884]\n",
            " [-1.61325225 -3.09760283 -0.58370128  0.50506857]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79436413]\n",
            " [-3.36918626]\n",
            " [-5.95565905]\n",
            " [-6.42804666]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79547761]\n",
            " [-3.36992952]\n",
            " [-5.95623491]\n",
            " [-6.42853793]]\n",
            "i 1289\n",
            "weight1 before iteration:\n",
            " [[ 5.90512492  2.25973265  5.89258606 -3.29494431]\n",
            " [ 5.96915032  1.62679803 -2.13512106  6.23315884]\n",
            " [-1.61325225 -3.09760283 -0.58370128  0.50506857]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90532895  2.26005137  5.89300606 -3.29524051]\n",
            " [ 5.96936436  1.62732209 -2.13541051  6.2335334 ]\n",
            " [-1.61331319 -3.09830045 -0.58362164  0.50517397]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79547761]\n",
            " [-3.36992952]\n",
            " [-5.95623491]\n",
            " [-6.42853793]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79658988]\n",
            " [-3.37067212]\n",
            " [-5.95681009]\n",
            " [-6.42902858]]\n",
            "i 1290\n",
            "weight1 before iteration:\n",
            " [[ 5.90532895  2.26005137  5.89300606 -3.29524051]\n",
            " [ 5.96936436  1.62732209 -2.13541051  6.2335334 ]\n",
            " [-1.61331319 -3.09830045 -0.58362164  0.50517397]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90553275  2.26036981  5.89342553 -3.29553634]\n",
            " [ 5.96957815  1.62784561 -2.13569963  6.23390748]\n",
            " [-1.61337407 -3.09899733 -0.58354207  0.50527925]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79658988]\n",
            " [-3.37067212]\n",
            " [-5.95681009]\n",
            " [-6.42902858]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79770092]\n",
            " [-3.37141407]\n",
            " [-5.95738458]\n",
            " [-6.42951862]]\n",
            "i 1291\n",
            "weight1 before iteration:\n",
            " [[ 5.90553275  2.26036981  5.89342553 -3.29553634]\n",
            " [ 5.96957815  1.62784561 -2.13569963  6.23390748]\n",
            " [-1.61337407 -3.09899733 -0.58354207  0.50527925]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90573629  2.26068796  5.89384448 -3.29583182]\n",
            " [ 5.96979168  1.62836859 -2.13598842  6.23428108]\n",
            " [-1.61343489 -3.09969348 -0.58346257  0.50538441]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79770092]\n",
            " [-3.37141407]\n",
            " [-5.95738458]\n",
            " [-6.42951862]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79881076]\n",
            " [-3.37215538]\n",
            " [-5.95795839]\n",
            " [-6.43000803]]\n",
            "i 1292\n",
            "weight1 before iteration:\n",
            " [[ 5.90573629  2.26068796  5.89384448 -3.29583182]\n",
            " [ 5.96979168  1.62836859 -2.13598842  6.23428108]\n",
            " [-1.61343489 -3.09969348 -0.58346257  0.50538441]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9059396   2.26100583  5.8942629  -3.29612694]\n",
            " [ 5.97000496  1.62889104 -2.13627687  6.23465421]\n",
            " [-1.61349565 -3.10038889 -0.58338312  0.50548945]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79881076]\n",
            " [-3.37215538]\n",
            " [-5.95795839]\n",
            " [-6.43000803]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.79991938]\n",
            " [-3.37289603]\n",
            " [-5.95853151]\n",
            " [-6.43049683]]\n",
            "i 1293\n",
            "weight1 before iteration:\n",
            " [[ 5.9059396   2.26100583  5.8942629  -3.29612694]\n",
            " [ 5.97000496  1.62889104 -2.13627687  6.23465421]\n",
            " [-1.61349565 -3.10038889 -0.58338312  0.50548945]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90614266  2.26132343  5.89468079 -3.2964217 ]\n",
            " [ 5.97021798  1.62941295 -2.13656498  6.23502686]\n",
            " [-1.61355635 -3.10108356 -0.58330374  0.50559437]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.79991938]\n",
            " [-3.37289603]\n",
            " [-5.95853151]\n",
            " [-6.43049683]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8010268 ]\n",
            " [-3.37363603]\n",
            " [-5.95910396]\n",
            " [-6.43098502]]\n",
            "i 1294\n",
            "weight1 before iteration:\n",
            " [[ 5.90614266  2.26132343  5.89468079 -3.2964217 ]\n",
            " [ 5.97021798  1.62941295 -2.13656498  6.23502686]\n",
            " [-1.61355635 -3.10108356 -0.58330374  0.50559437]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90634547  2.26164074  5.89509816 -3.29671611]\n",
            " [ 5.97043074  1.62993432 -2.13685276  6.23539904]\n",
            " [-1.61361699 -3.1017775  -0.58322442  0.50569918]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8010268 ]\n",
            " [-3.37363603]\n",
            " [-5.95910396]\n",
            " [-6.43098502]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80213302]\n",
            " [-3.37437538]\n",
            " [-5.95967572]\n",
            " [-6.43147259]]\n",
            "i 1295\n",
            "weight1 before iteration:\n",
            " [[ 5.90634547  2.26164074  5.89509816 -3.29671611]\n",
            " [ 5.97043074  1.62993432 -2.13685276  6.23539904]\n",
            " [-1.61361699 -3.1017775  -0.58322442  0.50569918]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90654805  2.26195777  5.895515   -3.29701015]\n",
            " [ 5.97064325  1.63045516 -2.13714021  6.23577075]\n",
            " [-1.61367757 -3.1024707  -0.58314516  0.50580388]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80213302]\n",
            " [-3.37437538]\n",
            " [-5.95967572]\n",
            " [-6.43147259]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80323803]\n",
            " [-3.37511409]\n",
            " [-5.96024681]\n",
            " [-6.43195955]]\n",
            "i 1296\n",
            "weight1 before iteration:\n",
            " [[ 5.90654805  2.26195777  5.895515   -3.29701015]\n",
            " [ 5.97064325  1.63045516 -2.13714021  6.23577075]\n",
            " [-1.61367757 -3.1024707  -0.58314516  0.50580388]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90675038  2.26227451  5.89593133 -3.29730385]\n",
            " [ 5.97085551  1.63097547 -2.13742733  6.23614198]\n",
            " [-1.61373808 -3.10316318 -0.58306596  0.50590845]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80323803]\n",
            " [-3.37511409]\n",
            " [-5.96024681]\n",
            " [-6.43195955]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80434184]\n",
            " [-3.37585215]\n",
            " [-5.96081722]\n",
            " [-6.43244589]]\n",
            "i 1297\n",
            "weight1 before iteration:\n",
            " [[ 5.90675038  2.26227451  5.89593133 -3.29730385]\n",
            " [ 5.97085551  1.63097547 -2.13742733  6.23614198]\n",
            " [-1.61373808 -3.10316318 -0.58306596  0.50590845]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90695247  2.26259098  5.89634713 -3.29759718]\n",
            " [ 5.97106751  1.63149525 -2.13771412  6.23651275]\n",
            " [-1.61379854 -3.10385492 -0.58298683  0.50601292]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80434184]\n",
            " [-3.37585215]\n",
            " [-5.96081722]\n",
            " [-6.43244589]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80544446]\n",
            " [-3.37658957]\n",
            " [-5.96138696]\n",
            " [-6.43293163]]\n",
            "i 1298\n",
            "weight1 before iteration:\n",
            " [[ 5.90695247  2.26259098  5.89634713 -3.29759718]\n",
            " [ 5.97106751  1.63149525 -2.13771412  6.23651275]\n",
            " [-1.61379854 -3.10385492 -0.58298683  0.50601292]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90715431  2.26290717  5.89676241 -3.29789017]\n",
            " [ 5.97127926  1.6320145  -2.13800057  6.23688304]\n",
            " [-1.61385894 -3.10454594 -0.58290775  0.50611726]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80544446]\n",
            " [-3.37658957]\n",
            " [-5.96138696]\n",
            " [-6.43293163]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80654588]\n",
            " [-3.37732634]\n",
            " [-5.96195603]\n",
            " [-6.43341676]]\n",
            "i 1299\n",
            "weight1 before iteration:\n",
            " [[ 5.90715431  2.26290717  5.89676241 -3.29789017]\n",
            " [ 5.97127926  1.6320145  -2.13800057  6.23688304]\n",
            " [-1.61385894 -3.10454594 -0.58290775  0.50611726]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90735592  2.26322309  5.89717718 -3.2981828 ]\n",
            " [ 5.97149076  1.63253321 -2.1382867   6.23725286]\n",
            " [-1.61391928 -3.10523623 -0.58282874  0.50622149]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80654588]\n",
            " [-3.37732634]\n",
            " [-5.96195603]\n",
            " [-6.43341676]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8076461 ]\n",
            " [-3.37806247]\n",
            " [-5.96252442]\n",
            " [-6.43390129]]\n",
            "i 1300\n",
            "weight1 before iteration:\n",
            " [[ 5.90735592  2.26322309  5.89717718 -3.2981828 ]\n",
            " [ 5.97149076  1.63253321 -2.1382867   6.23725286]\n",
            " [-1.61391928 -3.10523623 -0.58282874  0.50622149]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90755729  2.26353872  5.89759142 -3.29847508]\n",
            " [ 5.97170201  1.6330514  -2.1385725   6.23762222]\n",
            " [-1.61397956 -3.10592579 -0.58274979  0.50632561]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8076461 ]\n",
            " [-3.37806247]\n",
            " [-5.96252442]\n",
            " [-6.43390129]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80874514]\n",
            " [-3.37879796]\n",
            " [-5.96309214]\n",
            " [-6.4343852 ]]\n",
            "i 1301\n",
            "weight1 before iteration:\n",
            " [[ 5.90755729  2.26353872  5.89759142 -3.29847508]\n",
            " [ 5.97170201  1.6330514  -2.1385725   6.23762222]\n",
            " [-1.61397956 -3.10592579 -0.58274979  0.50632561]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90775842  2.26385407  5.89800515 -3.29876701]\n",
            " [ 5.971913    1.63356906 -2.13885797  6.23799111]\n",
            " [-1.61403977 -3.10661463 -0.58267091  0.50642961]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80874514]\n",
            " [-3.37879796]\n",
            " [-5.96309214]\n",
            " [-6.4343852 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.80984299]\n",
            " [-3.37953281]\n",
            " [-5.96365919]\n",
            " [-6.43486852]]\n",
            "i 1302\n",
            "weight1 before iteration:\n",
            " [[ 5.90775842  2.26385407  5.89800515 -3.29876701]\n",
            " [ 5.971913    1.63356906 -2.13885797  6.23799111]\n",
            " [-1.61403977 -3.10661463 -0.58267091  0.50642961]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90795931  2.26416915  5.89841837 -3.29905858]\n",
            " [ 5.97212375  1.6340862  -2.13914311  6.23835954]\n",
            " [-1.61409993 -3.10730275 -0.58259208  0.50653349]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.80984299]\n",
            " [-3.37953281]\n",
            " [-5.96365919]\n",
            " [-6.43486852]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81093965]\n",
            " [-3.38026702]\n",
            " [-5.96422558]\n",
            " [-6.43535123]]\n",
            "i 1303\n",
            "weight1 before iteration:\n",
            " [[ 5.90795931  2.26416915  5.89841837 -3.29905858]\n",
            " [ 5.97212375  1.6340862  -2.13914311  6.23835954]\n",
            " [-1.61409993 -3.10730275 -0.58259208  0.50653349]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90815996  2.26448395  5.89883107 -3.29934981]\n",
            " [ 5.97233424  1.6346028  -2.13942792  6.2387275 ]\n",
            " [-1.61416003 -3.10799015 -0.58251331  0.50663727]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81093965]\n",
            " [-3.38026702]\n",
            " [-5.96422558]\n",
            " [-6.43535123]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81203513]\n",
            " [-3.38100059]\n",
            " [-5.9647913 ]\n",
            " [-6.43583334]]\n",
            "i 1304\n",
            "weight1 before iteration:\n",
            " [[ 5.90815996  2.26448395  5.89883107 -3.29934981]\n",
            " [ 5.97233424  1.6346028  -2.13942792  6.2387275 ]\n",
            " [-1.61416003 -3.10799015 -0.58251331  0.50663727]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90836037  2.26479848  5.89924326 -3.29964069]\n",
            " [ 5.97254449  1.63511889 -2.13971241  6.23909499]\n",
            " [-1.61422008 -3.10867683 -0.58243461  0.50674092]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81203513]\n",
            " [-3.38100059]\n",
            " [-5.9647913 ]\n",
            " [-6.43583334]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81312943]\n",
            " [-3.38173353]\n",
            " [-5.96535635]\n",
            " [-6.43631485]]\n",
            "i 1305\n",
            "weight1 before iteration:\n",
            " [[ 5.90836037  2.26479848  5.89924326 -3.29964069]\n",
            " [ 5.97254449  1.63511889 -2.13971241  6.23909499]\n",
            " [-1.61422008 -3.10867683 -0.58243461  0.50674092]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90856054  2.26511273  5.89965493 -3.29993122]\n",
            " [ 5.97275449  1.63563445 -2.13999658  6.23946203]\n",
            " [-1.61428006 -3.10936279 -0.58235597  0.50684447]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81312943]\n",
            " [-3.38173353]\n",
            " [-5.96535635]\n",
            " [-6.43631485]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81422256]\n",
            " [-3.38246582]\n",
            " [-5.96592074]\n",
            " [-6.43679576]]\n",
            "i 1306\n",
            "weight1 before iteration:\n",
            " [[ 5.90856054  2.26511273  5.89965493 -3.29993122]\n",
            " [ 5.97275449  1.63563445 -2.13999658  6.23946203]\n",
            " [-1.61428006 -3.10936279 -0.58235597  0.50684447]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90876048  2.2654267   5.9000661  -3.3002214 ]\n",
            " [ 5.97296423  1.63614948 -2.14028041  6.2398286 ]\n",
            " [-1.61433998 -3.11004803 -0.58227739  0.5069479 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81422256]\n",
            " [-3.38246582]\n",
            " [-5.96592074]\n",
            " [-6.43679576]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8153145 ]\n",
            " [-3.38319749]\n",
            " [-5.96648447]\n",
            " [-6.43727607]]\n",
            "i 1307\n",
            "weight1 before iteration:\n",
            " [[ 5.90876048  2.2654267   5.9000661  -3.3002214 ]\n",
            " [ 5.97296423  1.63614948 -2.14028041  6.2398286 ]\n",
            " [-1.61433998 -3.11004803 -0.58227739  0.5069479 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90896018  2.2657404   5.90047675 -3.30051124]\n",
            " [ 5.97317373  1.636664   -2.14056393  6.24019471]\n",
            " [-1.61439985 -3.11073256 -0.58219887  0.50705121]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8153145 ]\n",
            " [-3.38319749]\n",
            " [-5.96648447]\n",
            " [-6.43727607]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81640528]\n",
            " [-3.38392852]\n",
            " [-5.96704754]\n",
            " [-6.43775579]]\n",
            "i 1308\n",
            "weight1 before iteration:\n",
            " [[ 5.90896018  2.2657404   5.90047675 -3.30051124]\n",
            " [ 5.97317373  1.636664   -2.14056393  6.24019471]\n",
            " [-1.61439985 -3.11073256 -0.58219887  0.50705121]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90915965  2.26605382  5.9008869  -3.30080073]\n",
            " [ 5.97338299  1.63717799 -2.14084712  6.24056037]\n",
            " [-1.61445965 -3.11141637 -0.58212041  0.50715442]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81640528]\n",
            " [-3.38392852]\n",
            " [-5.96704754]\n",
            " [-6.43775579]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81749488]\n",
            " [-3.38465891]\n",
            " [-5.96760995]\n",
            " [-6.43823491]]\n",
            "i 1309\n",
            "weight1 before iteration:\n",
            " [[ 5.90915965  2.26605382  5.9008869  -3.30080073]\n",
            " [ 5.97338299  1.63717799 -2.14084712  6.24056037]\n",
            " [-1.61445965 -3.11141637 -0.58212041  0.50715442]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90935888  2.26636697  5.90129654 -3.30108987]\n",
            " [ 5.97359199  1.63769146 -2.14112999  6.24092556]\n",
            " [-1.6145194  -3.11209947 -0.58204201  0.50725751]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81749488]\n",
            " [-3.38465891]\n",
            " [-5.96760995]\n",
            " [-6.43823491]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81858331]\n",
            " [-3.38538868]\n",
            " [-5.9681717 ]\n",
            " [-6.43871344]]\n",
            "i 1310\n",
            "weight1 before iteration:\n",
            " [[ 5.90935888  2.26636697  5.90129654 -3.30108987]\n",
            " [ 5.97359199  1.63769146 -2.14112999  6.24092556]\n",
            " [-1.6145194  -3.11209947 -0.58204201  0.50725751]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90955787  2.26667985  5.90170567 -3.30137867]\n",
            " [ 5.97380075  1.63820442 -2.14141254  6.2412903 ]\n",
            " [-1.61457909 -3.11278186 -0.58196367  0.50736049]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81858331]\n",
            " [-3.38538868]\n",
            " [-5.9681717 ]\n",
            " [-6.43871344]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.81967058]\n",
            " [-3.38611781]\n",
            " [-5.96873279]\n",
            " [-6.43919138]]\n",
            "i 1311\n",
            "weight1 before iteration:\n",
            " [[ 5.90955787  2.26667985  5.90170567 -3.30137867]\n",
            " [ 5.97380075  1.63820442 -2.14141254  6.2412903 ]\n",
            " [-1.61457909 -3.11278186 -0.58196367  0.50736049]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90975664  2.26699245  5.9021143  -3.30166712]\n",
            " [ 5.97400926  1.63871686 -2.14169476  6.24165458]\n",
            " [-1.61463872 -3.11346354 -0.5818854   0.50746335]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.81967058]\n",
            " [-3.38611781]\n",
            " [-5.96873279]\n",
            " [-6.43919138]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82075668]\n",
            " [-3.38684632]\n",
            " [-5.96929323]\n",
            " [-6.43966873]]\n",
            "i 1312\n",
            "weight1 before iteration:\n",
            " [[ 5.90975664  2.26699245  5.9021143  -3.30166712]\n",
            " [ 5.97400926  1.63871686 -2.14169476  6.24165458]\n",
            " [-1.61463872 -3.11346354 -0.5818854   0.50746335]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.90995516  2.26730478  5.90252243 -3.30195524]\n",
            " [ 5.97421753  1.63922877 -2.14197666  6.24201841]\n",
            " [-1.61469829 -3.11414451 -0.58180718  0.5075661 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82075668]\n",
            " [-3.38684632]\n",
            " [-5.96929323]\n",
            " [-6.43966873]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82184162]\n",
            " [-3.38757419]\n",
            " [-5.96985302]\n",
            " [-6.44014549]]\n",
            "i 1313\n",
            "weight1 before iteration:\n",
            " [[ 5.90995516  2.26730478  5.90252243 -3.30195524]\n",
            " [ 5.97421753  1.63922877 -2.14197666  6.24201841]\n",
            " [-1.61469829 -3.11414451 -0.58180718  0.5075661 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91015346  2.26761684  5.90293005 -3.302243  ]\n",
            " [ 5.97442556  1.63974018 -2.14225825  6.24238178]\n",
            " [-1.6147578  -3.11482478 -0.58172902  0.50766875]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82184162]\n",
            " [-3.38757419]\n",
            " [-5.96985302]\n",
            " [-6.44014549]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8229254 ]\n",
            " [-3.38830144]\n",
            " [-5.97041215]\n",
            " [-6.44062165]]\n",
            "i 1314\n",
            "weight1 before iteration:\n",
            " [[ 5.91015346  2.26761684  5.90293005 -3.302243  ]\n",
            " [ 5.97442556  1.63974018 -2.14225825  6.24238178]\n",
            " [-1.6147578  -3.11482478 -0.58172902  0.50766875]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91035152  2.26792862  5.90333717 -3.30253043]\n",
            " [ 5.97463334  1.64025107 -2.14253951  6.2427447 ]\n",
            " [-1.61481726 -3.11550433 -0.58165093  0.50777127]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8229254 ]\n",
            " [-3.38830144]\n",
            " [-5.97041215]\n",
            " [-6.44062165]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82400803]\n",
            " [-3.38902806]\n",
            " [-5.97097063]\n",
            " [-6.44109724]]\n",
            "i 1315\n",
            "weight1 before iteration:\n",
            " [[ 5.91035152  2.26792862  5.90333717 -3.30253043]\n",
            " [ 5.97463334  1.64025107 -2.14253951  6.2427447 ]\n",
            " [-1.61481726 -3.11550433 -0.58165093  0.50777127]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91054934  2.26824014  5.90374379 -3.30281752]\n",
            " [ 5.97484087  1.64076144 -2.14282046  6.24310716]\n",
            " [-1.61487666 -3.11618319 -0.58157289  0.50787369]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82400803]\n",
            " [-3.38902806]\n",
            " [-5.97097063]\n",
            " [-6.44109724]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8250895 ]\n",
            " [-3.38975406]\n",
            " [-5.97152847]\n",
            " [-6.44157223]]\n",
            "i 1316\n",
            "weight1 before iteration:\n",
            " [[ 5.91054934  2.26824014  5.90374379 -3.30281752]\n",
            " [ 5.97484087  1.64076144 -2.14282046  6.24310716]\n",
            " [-1.61487666 -3.11618319 -0.58157289  0.50787369]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91074694  2.26855138  5.90414991 -3.30310427]\n",
            " [ 5.97504816  1.6412713  -2.14310109  6.24346918]\n",
            " [-1.614936   -3.11686134 -0.58149492  0.507976  ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8250895 ]\n",
            " [-3.38975406]\n",
            " [-5.97152847]\n",
            " [-6.44157223]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82616982]\n",
            " [-3.39047943]\n",
            " [-5.97208565]\n",
            " [-6.44204665]]\n",
            "i 1317\n",
            "weight1 before iteration:\n",
            " [[ 5.91074694  2.26855138  5.90414991 -3.30310427]\n",
            " [ 5.97504816  1.6412713  -2.14310109  6.24346918]\n",
            " [-1.614936   -3.11686134 -0.58149492  0.507976  ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91094431  2.26886236  5.90455553 -3.30339067]\n",
            " [ 5.97525521  1.64178065 -2.1433814   6.24383074]\n",
            " [-1.61499528 -3.11753879 -0.58141701  0.50807819]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82616982]\n",
            " [-3.39047943]\n",
            " [-5.97208565]\n",
            " [-6.44204665]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82724898]\n",
            " [-3.39120418]\n",
            " [-5.97264219]\n",
            " [-6.44252047]]\n",
            "i 1318\n",
            "weight1 before iteration:\n",
            " [[ 5.91094431  2.26886236  5.90455553 -3.30339067]\n",
            " [ 5.97525521  1.64178065 -2.1433814   6.24383074]\n",
            " [-1.61499528 -3.11753879 -0.58141701  0.50807819]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91114144  2.26917306  5.90496065 -3.30367674]\n",
            " [ 5.97546202  1.64228948 -2.14366139  6.24419186]\n",
            " [-1.61505451 -3.11821554 -0.58133915  0.50818028]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82724898]\n",
            " [-3.39120418]\n",
            " [-5.97264219]\n",
            " [-6.44252047]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.828327  ]\n",
            " [-3.39192831]\n",
            " [-5.97319808]\n",
            " [-6.44299372]]\n",
            "i 1319\n",
            "weight1 before iteration:\n",
            " [[ 5.91114144  2.26917306  5.90496065 -3.30367674]\n",
            " [ 5.97546202  1.64228948 -2.14366139  6.24419186]\n",
            " [-1.61505451 -3.11821554 -0.58133915  0.50818028]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91133834  2.2694835   5.90536528 -3.30396247]\n",
            " [ 5.97566859  1.64279781 -2.14394107  6.24455252]\n",
            " [-1.61511367 -3.11889159 -0.58126136  0.50828225]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.828327  ]\n",
            " [-3.39192831]\n",
            " [-5.97319808]\n",
            " [-6.44299372]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.82940388]\n",
            " [-3.39265181]\n",
            " [-5.97375333]\n",
            " [-6.44346639]]\n",
            "i 1320\n",
            "weight1 before iteration:\n",
            " [[ 5.91133834  2.2694835   5.90536528 -3.30396247]\n",
            " [ 5.97566859  1.64279781 -2.14394107  6.24455252]\n",
            " [-1.61511367 -3.11889159 -0.58126136  0.50828225]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91153502  2.26979366  5.90576941 -3.30424786]\n",
            " [ 5.97587491  1.64330563 -2.14422043  6.24491274]\n",
            " [-1.61517278 -3.11956695 -0.58118362  0.50838411]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.82940388]\n",
            " [-3.39265181]\n",
            " [-5.97375333]\n",
            " [-6.44346639]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83047961]\n",
            " [-3.3933747 ]\n",
            " [-5.97430793]\n",
            " [-6.44393848]]\n",
            "i 1321\n",
            "weight1 before iteration:\n",
            " [[ 5.91153502  2.26979366  5.90576941 -3.30424786]\n",
            " [ 5.97587491  1.64330563 -2.14422043  6.24491274]\n",
            " [-1.61517278 -3.11956695 -0.58118362  0.50838411]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91173146  2.27010356  5.90617305 -3.30453292]\n",
            " [ 5.976081    1.64381293 -2.14449948  6.24527252]\n",
            " [-1.61523184 -3.1202416  -0.58110595  0.50848587]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83047961]\n",
            " [-3.3933747 ]\n",
            " [-5.97430793]\n",
            " [-6.44393848]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83155419]\n",
            " [-3.39409696]\n",
            " [-5.97486189]\n",
            " [-6.44440999]]\n",
            "i 1322\n",
            "weight1 before iteration:\n",
            " [[ 5.91173146  2.27010356  5.90617305 -3.30453292]\n",
            " [ 5.976081    1.64381293 -2.14449948  6.24527252]\n",
            " [-1.61523184 -3.1202416  -0.58110595  0.50848587]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91192768  2.27041319  5.90657619 -3.30481764]\n",
            " [ 5.97628684  1.64431973 -2.14477821  6.24563184]\n",
            " [-1.61529083 -3.12091557 -0.58102833  0.50858751]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83155419]\n",
            " [-3.39409696]\n",
            " [-5.97486189]\n",
            " [-6.44440999]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83262765]\n",
            " [-3.39481861]\n",
            " [-5.97541522]\n",
            " [-6.44488092]]\n",
            "i 1323\n",
            "weight1 before iteration:\n",
            " [[ 5.91192768  2.27041319  5.90657619 -3.30481764]\n",
            " [ 5.97628684  1.64431973 -2.14477821  6.24563184]\n",
            " [-1.61529083 -3.12091557 -0.58102833  0.50858751]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91212366  2.27072255  5.90697885 -3.30510203]\n",
            " [ 5.97649245  1.64482603 -2.14505663  6.24599073]\n",
            " [-1.61534977 -3.12158884 -0.58095078  0.50868904]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83262765]\n",
            " [-3.39481861]\n",
            " [-5.97541522]\n",
            " [-6.44488092]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83369996]\n",
            " [-3.39553964]\n",
            " [-5.9759679 ]\n",
            " [-6.44535128]]\n",
            "i 1324\n",
            "weight1 before iteration:\n",
            " [[ 5.91212366  2.27072255  5.90697885 -3.30510203]\n",
            " [ 5.97649245  1.64482603 -2.14505663  6.24599073]\n",
            " [-1.61534977 -3.12158884 -0.58095078  0.50868904]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91231942  2.27103164  5.90738101 -3.30538608]\n",
            " [ 5.97669781  1.64533182 -2.14533474  6.24634917]\n",
            " [-1.61540866 -3.12226141 -0.58087328  0.50879047]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83369996]\n",
            " [-3.39553964]\n",
            " [-5.9759679 ]\n",
            " [-6.44535128]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83477114]\n",
            " [-3.39626005]\n",
            " [-5.97651995]\n",
            " [-6.44582106]]\n",
            "i 1325\n",
            "weight1 before iteration:\n",
            " [[ 5.91231942  2.27103164  5.90738101 -3.30538608]\n",
            " [ 5.97669781  1.64533182 -2.14533474  6.24634917]\n",
            " [-1.61540866 -3.12226141 -0.58087328  0.50879047]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91251495  2.27134047  5.90778268 -3.30566979]\n",
            " [ 5.97690294  1.6458371  -2.14561253  6.24670717]\n",
            " [-1.61546748 -3.1229333  -0.58079584  0.50889178]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83477114]\n",
            " [-3.39626005]\n",
            " [-5.97651995]\n",
            " [-6.44582106]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83584119]\n",
            " [-3.39697985]\n",
            " [-5.97707136]\n",
            " [-6.44629027]]\n",
            "i 1326\n",
            "weight1 before iteration:\n",
            " [[ 5.91251495  2.27134047  5.90778268 -3.30566979]\n",
            " [ 5.97690294  1.6458371  -2.14561253  6.24670717]\n",
            " [-1.61546748 -3.1229333  -0.58079584  0.50889178]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91271026  2.27164903  5.90818386 -3.30595318]\n",
            " [ 5.97710783  1.64634188 -2.14589001  6.24706472]\n",
            " [-1.61552625 -3.1236045  -0.58071847  0.50899298]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83584119]\n",
            " [-3.39697985]\n",
            " [-5.97707136]\n",
            " [-6.44629027]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8369101 ]\n",
            " [-3.39769904]\n",
            " [-5.97762213]\n",
            " [-6.44675891]]\n",
            "i 1327\n",
            "weight1 before iteration:\n",
            " [[ 5.91271026  2.27164903  5.90818386 -3.30595318]\n",
            " [ 5.97710783  1.64634188 -2.14589001  6.24706472]\n",
            " [-1.61552625 -3.1236045  -0.58071847  0.50899298]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91290533  2.27195733  5.90858456 -3.30623623]\n",
            " [ 5.97731248  1.64684615 -2.14616718  6.24742184]\n",
            " [-1.61558496 -3.12427501 -0.58064115  0.50909408]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8369101 ]\n",
            " [-3.39769904]\n",
            " [-5.97762213]\n",
            " [-6.44675891]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83797789]\n",
            " [-3.39841761]\n",
            " [-5.97817227]\n",
            " [-6.44722698]]\n",
            "i 1328\n",
            "weight1 before iteration:\n",
            " [[ 5.91290533  2.27195733  5.90858456 -3.30623623]\n",
            " [ 5.97731248  1.64684615 -2.14616718  6.24742184]\n",
            " [-1.61558496 -3.12427501 -0.58064115  0.50909408]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91310018  2.27226536  5.90898477 -3.30651895]\n",
            " [ 5.9775169   1.64734992 -2.14644405  6.24777852]\n",
            " [-1.61564362 -3.12494483 -0.58056389  0.50919507]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83797789]\n",
            " [-3.39841761]\n",
            " [-5.97817227]\n",
            " [-6.44722698]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.83904456]\n",
            " [-3.39913557]\n",
            " [-5.97872178]\n",
            " [-6.44769448]]\n",
            "i 1329\n",
            "weight1 before iteration:\n",
            " [[ 5.91310018  2.27226536  5.90898477 -3.30651895]\n",
            " [ 5.9775169   1.64734992 -2.14644405  6.24777852]\n",
            " [-1.61564362 -3.12494483 -0.58056389  0.50919507]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91329481  2.27257312  5.90938449 -3.30680134]\n",
            " [ 5.97772107  1.6478532  -2.1467206   6.24813475]\n",
            " [-1.61570222 -3.12561397 -0.58048669  0.50929595]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.83904456]\n",
            " [-3.39913557]\n",
            " [-5.97872178]\n",
            " [-6.44769448]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8401101 ]\n",
            " [-3.39985292]\n",
            " [-5.97927066]\n",
            " [-6.44816141]]\n",
            "i 1330\n",
            "weight1 before iteration:\n",
            " [[ 5.91329481  2.27257312  5.90938449 -3.30680134]\n",
            " [ 5.97772107  1.6478532  -2.1467206   6.24813475]\n",
            " [-1.61570222 -3.12561397 -0.58048669  0.50929595]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91348921  2.27288062  5.90978373 -3.3070834 ]\n",
            " [ 5.97792502  1.64835597 -2.14699684  6.24849055]\n",
            " [-1.61576076 -3.12628242 -0.58040955  0.50939672]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8401101 ]\n",
            " [-3.39985292]\n",
            " [-5.97927066]\n",
            " [-6.44816141]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84117452]\n",
            " [-3.40056965]\n",
            " [-5.97981891]\n",
            " [-6.44862778]]\n",
            "i 1331\n",
            "weight1 before iteration:\n",
            " [[ 5.91348921  2.27288062  5.90978373 -3.3070834 ]\n",
            " [ 5.97792502  1.64835597 -2.14699684  6.24849055]\n",
            " [-1.61576076 -3.12628242 -0.58040955  0.50939672]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91368339  2.27318786  5.91018248 -3.30736513]\n",
            " [ 5.97812872  1.64885824 -2.14727277  6.24884592]\n",
            " [-1.61581925 -3.12695019 -0.58033246  0.50949738]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84117452]\n",
            " [-3.40056965]\n",
            " [-5.97981891]\n",
            " [-6.44862778]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84223782]\n",
            " [-3.40128578]\n",
            " [-5.98036653]\n",
            " [-6.44909358]]\n",
            "i 1332\n",
            "weight1 before iteration:\n",
            " [[ 5.91368339  2.27318786  5.91018248 -3.30736513]\n",
            " [ 5.97812872  1.64885824 -2.14727277  6.24884592]\n",
            " [-1.61581925 -3.12695019 -0.58033246  0.50949738]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91387734  2.27349483  5.91058075 -3.30764653]\n",
            " [ 5.97833219  1.64936001 -2.1475484   6.24920085]\n",
            " [-1.61587768 -3.12761728 -0.58025544  0.50959793]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84223782]\n",
            " [-3.40128578]\n",
            " [-5.98036653]\n",
            " [-6.44909358]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8433    ]\n",
            " [-3.4020013 ]\n",
            " [-5.98091352]\n",
            " [-6.44955881]]\n",
            "i 1333\n",
            "weight1 before iteration:\n",
            " [[ 5.91387734  2.27349483  5.91058075 -3.30764653]\n",
            " [ 5.97833219  1.64936001 -2.1475484   6.24920085]\n",
            " [-1.61587768 -3.12761728 -0.58025544  0.50959793]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91407107  2.27380154  5.91097854 -3.3079276 ]\n",
            " [ 5.97853543  1.64986129 -2.14782372  6.24955534]\n",
            " [-1.61593605 -3.12828369 -0.58017848  0.50969838]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8433    ]\n",
            " [-3.4020013 ]\n",
            " [-5.98091352]\n",
            " [-6.44955881]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84436107]\n",
            " [-3.40271622]\n",
            " [-5.98145989]\n",
            " [-6.45002348]]\n",
            "i 1334\n",
            "weight1 before iteration:\n",
            " [[ 5.91407107  2.27380154  5.91097854 -3.3079276 ]\n",
            " [ 5.97853543  1.64986129 -2.14782372  6.24955534]\n",
            " [-1.61593605 -3.12828369 -0.58017848  0.50969838]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91426457  2.27410799  5.91137585 -3.30820834]\n",
            " [ 5.97873843  1.65036207 -2.14809873  6.2499094 ]\n",
            " [-1.61599437 -3.12894942 -0.58010157  0.50979872]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84436107]\n",
            " [-3.40271622]\n",
            " [-5.98145989]\n",
            " [-6.45002348]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84542103]\n",
            " [-3.40343053]\n",
            " [-5.98200563]\n",
            " [-6.45048759]]\n",
            "i 1335\n",
            "weight1 before iteration:\n",
            " [[ 5.91426457  2.27410799  5.91137585 -3.30820834]\n",
            " [ 5.97873843  1.65036207 -2.14809873  6.2499094 ]\n",
            " [-1.61599437 -3.12894942 -0.58010157  0.50979872]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91445785  2.27441417  5.91177268 -3.30848876]\n",
            " [ 5.9789412   1.65086235 -2.14837344  6.25026302]\n",
            " [-1.61605263 -3.12961447 -0.58002472  0.50989895]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84542103]\n",
            " [-3.40343053]\n",
            " [-5.98200563]\n",
            " [-6.45048759]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84647988]\n",
            " [-3.40414423]\n",
            " [-5.98255075]\n",
            " [-6.45095114]]\n",
            "i 1336\n",
            "weight1 before iteration:\n",
            " [[ 5.91445785  2.27441417  5.91177268 -3.30848876]\n",
            " [ 5.9789412   1.65086235 -2.14837344  6.25026302]\n",
            " [-1.61605263 -3.12961447 -0.58002472  0.50989895]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91465091  2.2747201   5.91216903 -3.30876885]\n",
            " [ 5.97914374  1.65136214 -2.14864784  6.25061622]\n",
            " [-1.61611084 -3.13027885 -0.57994793  0.50999908]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84647988]\n",
            " [-3.40414423]\n",
            " [-5.98255075]\n",
            " [-6.45095114]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84753762]\n",
            " [-3.40485733]\n",
            " [-5.98309524]\n",
            " [-6.45141413]]\n",
            "i 1337\n",
            "weight1 before iteration:\n",
            " [[ 5.91465091  2.2747201   5.91216903 -3.30876885]\n",
            " [ 5.97914374  1.65136214 -2.14864784  6.25061622]\n",
            " [-1.61611084 -3.13027885 -0.57994793  0.50999908]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91484375  2.27502576  5.9125649  -3.30904862]\n",
            " [ 5.97934604  1.65186144 -2.14892194  6.25096898]\n",
            " [-1.61616899 -3.13094255 -0.5798712   0.51009909]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84753762]\n",
            " [-3.40485733]\n",
            " [-5.98309524]\n",
            " [-6.45141413]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84859426]\n",
            " [-3.40556982]\n",
            " [-5.98363912]\n",
            " [-6.45187657]]\n",
            "i 1338\n",
            "weight1 before iteration:\n",
            " [[ 5.91484375  2.27502576  5.9125649  -3.30904862]\n",
            " [ 5.97934604  1.65186144 -2.14892194  6.25096898]\n",
            " [-1.61616899 -3.13094255 -0.5798712   0.51009909]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91503637  2.27533116  5.9129603  -3.30932806]\n",
            " [ 5.97954811  1.65236024 -2.14919573  6.25132132]\n",
            " [-1.61622709 -3.13160558 -0.57979453  0.51019901]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84859426]\n",
            " [-3.40556982]\n",
            " [-5.98363912]\n",
            " [-6.45187657]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.84964979]\n",
            " [-3.40628172]\n",
            " [-5.98418237]\n",
            " [-6.45233844]]\n",
            "i 1339\n",
            "weight1 before iteration:\n",
            " [[ 5.91503637  2.27533116  5.9129603  -3.30932806]\n",
            " [ 5.97954811  1.65236024 -2.14919573  6.25132132]\n",
            " [-1.61622709 -3.13160558 -0.57979453  0.51019901]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91522876  2.2756363   5.91335522 -3.30960718]\n",
            " [ 5.97974995  1.65285855 -2.14946922  6.25167322]\n",
            " [-1.61628513 -3.13226793 -0.57971792  0.51029881]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.84964979]\n",
            " [-3.40628172]\n",
            " [-5.98418237]\n",
            " [-6.45233844]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85070422]\n",
            " [-3.40699301]\n",
            " [-5.98472501]\n",
            " [-6.45279976]]\n",
            "i 1340\n",
            "weight1 before iteration:\n",
            " [[ 5.91522876  2.2756363   5.91335522 -3.30960718]\n",
            " [ 5.97974995  1.65285855 -2.14946922  6.25167322]\n",
            " [-1.61628513 -3.13226793 -0.57971792  0.51029881]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91542094  2.27594118  5.91374967 -3.30988597]\n",
            " [ 5.97995156  1.65335637 -2.14974241  6.2520247 ]\n",
            " [-1.61634312 -3.13292962 -0.57964136  0.51039851]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85070422]\n",
            " [-3.40699301]\n",
            " [-5.98472501]\n",
            " [-6.45279976]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85175755]\n",
            " [-3.4077037 ]\n",
            " [-5.98526703]\n",
            " [-6.45326052]]\n",
            "i 1341\n",
            "weight1 before iteration:\n",
            " [[ 5.91542094  2.27594118  5.91374967 -3.30988597]\n",
            " [ 5.97995156  1.65335637 -2.14974241  6.2520247 ]\n",
            " [-1.61634312 -3.13292962 -0.57964136  0.51039851]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91561289  2.2762458   5.91414364 -3.31016445]\n",
            " [ 5.98015293  1.65385369 -2.15001529  6.25237574]\n",
            " [-1.61640105 -3.13359063 -0.57956486  0.5104981 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85175755]\n",
            " [-3.4077037 ]\n",
            " [-5.98526703]\n",
            " [-6.45326052]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85280978]\n",
            " [-3.4084138 ]\n",
            " [-5.98580844]\n",
            " [-6.45372074]]\n",
            "i 1342\n",
            "weight1 before iteration:\n",
            " [[ 5.91561289  2.2762458   5.91414364 -3.31016445]\n",
            " [ 5.98015293  1.65385369 -2.15001529  6.25237574]\n",
            " [-1.61640105 -3.13359063 -0.57956486  0.5104981 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91580463  2.27655016  5.91453714 -3.3104426 ]\n",
            " [ 5.98035408  1.65435053 -2.15028787  6.25272637]\n",
            " [-1.61645892 -3.13425098 -0.57948842  0.51059759]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85280978]\n",
            " [-3.4084138 ]\n",
            " [-5.98580844]\n",
            " [-6.45372074]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85386092]\n",
            " [-3.40912329]\n",
            " [-5.98634923]\n",
            " [-6.4541804 ]]\n",
            "i 1343\n",
            "weight1 before iteration:\n",
            " [[ 5.91580463  2.27655016  5.91453714 -3.3104426 ]\n",
            " [ 5.98035408  1.65435053 -2.15028787  6.25272637]\n",
            " [-1.61645892 -3.13425098 -0.57948842  0.51059759]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91599615  2.27685426  5.91493017 -3.31072043]\n",
            " [ 5.980555    1.65484688 -2.15056016  6.25307656]\n",
            " [-1.61651674 -3.13491066 -0.57941204  0.51069697]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85386092]\n",
            " [-3.40912329]\n",
            " [-5.98634923]\n",
            " [-6.4541804 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85491097]\n",
            " [-3.40983219]\n",
            " [-5.98688941]\n",
            " [-6.4546395 ]]\n",
            "i 1344\n",
            "weight1 before iteration:\n",
            " [[ 5.91599615  2.27685426  5.91493017 -3.31072043]\n",
            " [ 5.980555    1.65484688 -2.15056016  6.25307656]\n",
            " [-1.61651674 -3.13491066 -0.57941204  0.51069697]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91618745  2.27715811  5.91532273 -3.31099793]\n",
            " [ 5.98075569  1.65534274 -2.15083214  6.25342634]\n",
            " [-1.61657451 -3.13556967 -0.57933571  0.51079625]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85491097]\n",
            " [-3.40983219]\n",
            " [-5.98688941]\n",
            " [-6.4546395 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85595992]\n",
            " [-3.41054049]\n",
            " [-5.98742897]\n",
            " [-6.45509806]]\n",
            "i 1345\n",
            "weight1 before iteration:\n",
            " [[ 5.91618745  2.27715811  5.91532273 -3.31099793]\n",
            " [ 5.98075569  1.65534274 -2.15083214  6.25342634]\n",
            " [-1.61657451 -3.13556967 -0.57933571  0.51079625]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91637853  2.27746169  5.91571482 -3.31127512]\n",
            " [ 5.98095615  1.65583812 -2.15110382  6.25377568]\n",
            " [-1.61663222 -3.13622802 -0.57925945  0.51089542]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85595992]\n",
            " [-3.41054049]\n",
            " [-5.98742897]\n",
            " [-6.45509806]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85700779]\n",
            " [-3.4112482 ]\n",
            " [-5.98796793]\n",
            " [-6.45555607]]\n",
            "i 1346\n",
            "weight1 before iteration:\n",
            " [[ 5.91637853  2.27746169  5.91571482 -3.31127512]\n",
            " [ 5.98095615  1.65583812 -2.15110382  6.25377568]\n",
            " [-1.61663222 -3.13622802 -0.57925945  0.51089542]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91656939  2.27776502  5.91610644 -3.31155199]\n",
            " [ 5.98115638  1.656333   -2.1513752   6.25412461]\n",
            " [-1.61668988 -3.1368857  -0.57918324  0.51099449]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85700779]\n",
            " [-3.4112482 ]\n",
            " [-5.98796793]\n",
            " [-6.45555607]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85805457]\n",
            " [-3.41195531]\n",
            " [-5.98850627]\n",
            " [-6.45601353]]\n",
            "i 1347\n",
            "weight1 before iteration:\n",
            " [[ 5.91656939  2.27776502  5.91610644 -3.31155199]\n",
            " [ 5.98115638  1.656333   -2.1513752   6.25412461]\n",
            " [-1.61668988 -3.1368857  -0.57918324  0.51099449]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91676003  2.27806809  5.9164976  -3.31182854]\n",
            " [ 5.98135638  1.65682741 -2.15164629  6.25447312]\n",
            " [-1.61674748 -3.13754273 -0.57910709  0.51109345]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85805457]\n",
            " [-3.41195531]\n",
            " [-5.98850627]\n",
            " [-6.45601353]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.85910026]\n",
            " [-3.41266183]\n",
            " [-5.98904401]\n",
            " [-6.45647045]]\n",
            "i 1348\n",
            "weight1 before iteration:\n",
            " [[ 5.91676003  2.27806809  5.9164976  -3.31182854]\n",
            " [ 5.98135638  1.65682741 -2.15164629  6.25447312]\n",
            " [-1.61674748 -3.13754273 -0.57910709  0.51109345]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91695046  2.27837091  5.91688829 -3.31210477]\n",
            " [ 5.98155615  1.65732133 -2.15191707  6.2548212 ]\n",
            " [-1.61680503 -3.13819909 -0.57903099  0.51119231]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.85910026]\n",
            " [-3.41266183]\n",
            " [-5.98904401]\n",
            " [-6.45647045]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86014487]\n",
            " [-3.41336776]\n",
            " [-5.98958114]\n",
            " [-6.45692682]]\n",
            "i 1349\n",
            "weight1 before iteration:\n",
            " [[ 5.91695046  2.27837091  5.91688829 -3.31210477]\n",
            " [ 5.98155615  1.65732133 -2.15191707  6.2548212 ]\n",
            " [-1.61680503 -3.13819909 -0.57903099  0.51119231]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91714067  2.27867347  5.91727851 -3.31238069]\n",
            " [ 5.9817557   1.65781476 -2.15218756  6.25516886]\n",
            " [-1.61686252 -3.13885479 -0.57895495  0.51129106]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86014487]\n",
            " [-3.41336776]\n",
            " [-5.98958114]\n",
            " [-6.45692682]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86118841]\n",
            " [-3.41407309]\n",
            " [-5.99011766]\n",
            " [-6.45738264]]\n",
            "i 1350\n",
            "weight1 before iteration:\n",
            " [[ 5.91714067  2.27867347  5.91727851 -3.31238069]\n",
            " [ 5.9817557   1.65781476 -2.15218756  6.25516886]\n",
            " [-1.61686252 -3.13885479 -0.57895495  0.51129106]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91733067  2.27897577  5.91766827 -3.31265629]\n",
            " [ 5.98195503  1.65830771 -2.15245775  6.25551611]\n",
            " [-1.61691996 -3.13950983 -0.57887897  0.51138971]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86118841]\n",
            " [-3.41407309]\n",
            " [-5.99011766]\n",
            " [-6.45738264]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86223086]\n",
            " [-3.41477784]\n",
            " [-5.99065358]\n",
            " [-6.45783793]]\n",
            "i 1351\n",
            "weight1 before iteration:\n",
            " [[ 5.91733067  2.27897577  5.91766827 -3.31265629]\n",
            " [ 5.98195503  1.65830771 -2.15245775  6.25551611]\n",
            " [-1.61691996 -3.13950983 -0.57887897  0.51138971]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91752045  2.27927782  5.91805756 -3.31293157]\n",
            " [ 5.98215412  1.65880018 -2.15272765  6.25586293]\n",
            " [-1.61697735 -3.14016422 -0.57880305  0.51148825]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86223086]\n",
            " [-3.41477784]\n",
            " [-5.99065358]\n",
            " [-6.45783793]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86327224]\n",
            " [-3.41548199]\n",
            " [-5.9911889 ]\n",
            " [-6.45829267]]\n",
            "i 1352\n",
            "weight1 before iteration:\n",
            " [[ 5.91752045  2.27927782  5.91805756 -3.31293157]\n",
            " [ 5.98215412  1.65880018 -2.15272765  6.25586293]\n",
            " [-1.61697735 -3.14016422 -0.57880305  0.51148825]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91771002  2.27957961  5.91844639 -3.31320654]\n",
            " [ 5.98235299  1.65929217 -2.15299725  6.25620934]\n",
            " [-1.61703468 -3.14081795 -0.57872719  0.51158669]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86327224]\n",
            " [-3.41548199]\n",
            " [-5.9911889 ]\n",
            " [-6.45829267]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86431255]\n",
            " [-3.41618556]\n",
            " [-5.99172361]\n",
            " [-6.45874687]]\n",
            "i 1353\n",
            "weight1 before iteration:\n",
            " [[ 5.91771002  2.27957961  5.91844639 -3.31320654]\n",
            " [ 5.98235299  1.65929217 -2.15299725  6.25620934]\n",
            " [-1.61703468 -3.14081795 -0.57872719  0.51158669]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91789937  2.27988115  5.91883476 -3.31348119]\n",
            " [ 5.98255164  1.65978368 -2.15326656  6.25655533]\n",
            " [-1.61709196 -3.14147103 -0.57865138  0.51168503]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86431255]\n",
            " [-3.41618556]\n",
            " [-5.99172361]\n",
            " [-6.45874687]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86535178]\n",
            " [-3.41688854]\n",
            " [-5.99225773]\n",
            " [-6.45920053]]\n",
            "i 1354\n",
            "weight1 before iteration:\n",
            " [[ 5.91789937  2.27988115  5.91883476 -3.31348119]\n",
            " [ 5.98255164  1.65978368 -2.15326656  6.25655533]\n",
            " [-1.61709196 -3.14147103 -0.57865138  0.51168503]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91808851  2.28018243  5.91922267 -3.31375553]\n",
            " [ 5.98275006  1.66027471 -2.15353557  6.25690091]\n",
            " [-1.61714918 -3.14212345 -0.57857563  0.51178327]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86535178]\n",
            " [-3.41688854]\n",
            " [-5.99225773]\n",
            " [-6.45920053]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86638994]\n",
            " [-3.41759093]\n",
            " [-5.99279124]\n",
            " [-6.45965366]]\n",
            "i 1355\n",
            "weight1 before iteration:\n",
            " [[ 5.91808851  2.28018243  5.91922267 -3.31375553]\n",
            " [ 5.98275006  1.66027471 -2.15353557  6.25690091]\n",
            " [-1.61714918 -3.14212345 -0.57857563  0.51178327]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91827743  2.28048346  5.91961012 -3.31402955]\n",
            " [ 5.98294826  1.66076527 -2.15380428  6.25724607]\n",
            " [-1.61720635 -3.14277522 -0.57849993  0.5118814 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86638994]\n",
            " [-3.41759093]\n",
            " [-5.99279124]\n",
            " [-6.45965366]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86742704]\n",
            " [-3.41829274]\n",
            " [-5.99332416]\n",
            " [-6.46010624]]\n",
            "i 1356\n",
            "weight1 before iteration:\n",
            " [[ 5.91827743  2.28048346  5.91961012 -3.31402955]\n",
            " [ 5.98294826  1.66076527 -2.15380428  6.25724607]\n",
            " [-1.61720635 -3.14277522 -0.57849993  0.5118814 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91846614  2.28078424  5.91999711 -3.31430326]\n",
            " [ 5.98314623  1.66125534 -2.15407271  6.25759082]\n",
            " [-1.61726347 -3.14342634 -0.57842429  0.51197943]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86742704]\n",
            " [-3.41829274]\n",
            " [-5.99332416]\n",
            " [-6.46010624]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86846307]\n",
            " [-3.41899396]\n",
            " [-5.99385647]\n",
            " [-6.46055829]]\n",
            "i 1357\n",
            "weight1 before iteration:\n",
            " [[ 5.91846614  2.28078424  5.91999711 -3.31430326]\n",
            " [ 5.98314623  1.66125534 -2.15407271  6.25759082]\n",
            " [-1.61726347 -3.14342634 -0.57842429  0.51197943]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91865464  2.28108476  5.92038365 -3.31457667]\n",
            " [ 5.98334398  1.66174494 -2.15434084  6.25793516]\n",
            " [-1.61732053 -3.14407681 -0.57834871  0.51207735]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86846307]\n",
            " [-3.41899396]\n",
            " [-5.99385647]\n",
            " [-6.46055829]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.86949803]\n",
            " [-3.4196946 ]\n",
            " [-5.99438819]\n",
            " [-6.46100981]]\n",
            "i 1358\n",
            "weight1 before iteration:\n",
            " [[ 5.91865464  2.28108476  5.92038365 -3.31457667]\n",
            " [ 5.98334398  1.66174494 -2.15434084  6.25793516]\n",
            " [-1.61732053 -3.14407681 -0.57834871  0.51207735]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91884292  2.28138503  5.92076972 -3.31484975]\n",
            " [ 5.98354151  1.66223406 -2.15460868  6.25827908]\n",
            " [-1.61737754 -3.14472663 -0.57827318  0.51217518]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.86949803]\n",
            " [-3.4196946 ]\n",
            " [-5.99438819]\n",
            " [-6.46100981]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87053194]\n",
            " [-3.42039466]\n",
            " [-5.99491932]\n",
            " [-6.46146079]]\n",
            "i 1359\n",
            "weight1 before iteration:\n",
            " [[ 5.91884292  2.28138503  5.92076972 -3.31484975]\n",
            " [ 5.98354151  1.66223406 -2.15460868  6.25827908]\n",
            " [-1.61737754 -3.14472663 -0.57827318  0.51217518]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.919031    2.28168505  5.92115534 -3.31512253]\n",
            " [ 5.98373881  1.66272271 -2.15487623  6.25862259]\n",
            " [-1.6174345  -3.1453758  -0.57819772  0.5122729 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87053194]\n",
            " [-3.42039466]\n",
            " [-5.99491932]\n",
            " [-6.46146079]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87156478]\n",
            " [-3.42109413]\n",
            " [-5.99544985]\n",
            " [-6.46191124]]\n",
            "i 1360\n",
            "weight1 before iteration:\n",
            " [[ 5.919031    2.28168505  5.92115534 -3.31512253]\n",
            " [ 5.98373881  1.66272271 -2.15487623  6.25862259]\n",
            " [-1.6174345  -3.1453758  -0.57819772  0.5122729 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91921886  2.28198482  5.92154051 -3.315395  ]\n",
            " [ 5.9839359   1.66321088 -2.15514349  6.25896569]\n",
            " [-1.6174914  -3.14602433 -0.5781223   0.51237052]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87156478]\n",
            " [-3.42109413]\n",
            " [-5.99544985]\n",
            " [-6.46191124]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87259657]\n",
            " [-3.42179303]\n",
            " [-5.99597979]\n",
            " [-6.46236116]]\n",
            "i 1361\n",
            "weight1 before iteration:\n",
            " [[ 5.91921886  2.28198482  5.92154051 -3.315395  ]\n",
            " [ 5.9839359   1.66321088 -2.15514349  6.25896569]\n",
            " [-1.6174914  -3.14602433 -0.5781223   0.51237052]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91940651  2.28228433  5.92192522 -3.31566716]\n",
            " [ 5.98413276  1.66369858 -2.15541045  6.25930839]\n",
            " [-1.61754825 -3.14667221 -0.57804695  0.51246803]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87259657]\n",
            " [-3.42179303]\n",
            " [-5.99597979]\n",
            " [-6.46236116]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8736273 ]\n",
            " [-3.42249134]\n",
            " [-5.99650914]\n",
            " [-6.46281055]]\n",
            "i 1362\n",
            "weight1 before iteration:\n",
            " [[ 5.91940651  2.28228433  5.92192522 -3.31566716]\n",
            " [ 5.98413276  1.66369858 -2.15541045  6.25930839]\n",
            " [-1.61754825 -3.14667221 -0.57804695  0.51246803]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91959395  2.2825836   5.92230948 -3.31593901]\n",
            " [ 5.9843294   1.66418581 -2.15567713  6.25965067]\n",
            " [-1.61760505 -3.14731945 -0.57797165  0.51256545]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8736273 ]\n",
            " [-3.42249134]\n",
            " [-5.99650914]\n",
            " [-6.46281055]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87465698]\n",
            " [-3.42318907]\n",
            " [-5.9970379 ]\n",
            " [-6.46325941]]\n",
            "i 1363\n",
            "weight1 before iteration:\n",
            " [[ 5.91959395  2.2825836   5.92230948 -3.31593901]\n",
            " [ 5.9843294   1.66418581 -2.15567713  6.25965067]\n",
            " [-1.61760505 -3.14731945 -0.57797165  0.51256545]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.91978118  2.28288261  5.92269329 -3.31621055]\n",
            " [ 5.98452582  1.66467257 -2.15594352  6.25999255]\n",
            " [-1.61766179 -3.14796604 -0.5778964   0.51266276]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87465698]\n",
            " [-3.42318907]\n",
            " [-5.9970379 ]\n",
            " [-6.46325941]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87568561]\n",
            " [-3.42388623]\n",
            " [-5.99756607]\n",
            " [-6.46370774]]\n",
            "i 1364\n",
            "weight1 before iteration:\n",
            " [[ 5.91978118  2.28288261  5.92269329 -3.31621055]\n",
            " [ 5.98452582  1.66467257 -2.15594352  6.25999255]\n",
            " [-1.61766179 -3.14796604 -0.5778964   0.51266276]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9199682   2.28318138  5.92307664 -3.31648178]\n",
            " [ 5.98472202  1.66515885 -2.15620962  6.26033402]\n",
            " [-1.61771848 -3.148612   -0.57782122  0.51275998]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87568561]\n",
            " [-3.42388623]\n",
            " [-5.99756607]\n",
            " [-6.46370774]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87671319]\n",
            " [-3.42458281]\n",
            " [-5.99809365]\n",
            " [-6.46415554]]\n",
            "i 1365\n",
            "weight1 before iteration:\n",
            " [[ 5.9199682   2.28318138  5.92307664 -3.31648178]\n",
            " [ 5.98472202  1.66515885 -2.15620962  6.26033402]\n",
            " [-1.61771848 -3.148612   -0.57782122  0.51275998]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92015501  2.28347989  5.92345955 -3.31675271]\n",
            " [ 5.984918    1.66564467 -2.15647543  6.26067508]\n",
            " [-1.61777512 -3.14925731 -0.57774609  0.51285709]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87671319]\n",
            " [-3.42458281]\n",
            " [-5.99809365]\n",
            " [-6.46415554]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87773972]\n",
            " [-3.42527881]\n",
            " [-5.99862065]\n",
            " [-6.46460282]]\n",
            "i 1366\n",
            "weight1 before iteration:\n",
            " [[ 5.92015501  2.28347989  5.92345955 -3.31675271]\n",
            " [ 5.984918    1.66564467 -2.15647543  6.26067508]\n",
            " [-1.61777512 -3.14925731 -0.57774609  0.51285709]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92034161  2.28377816  5.92384201 -3.31702333]\n",
            " [ 5.98511376  1.66613002 -2.15674095  6.26101574]\n",
            " [-1.61783171 -3.14990199 -0.57767101  0.5129541 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87773972]\n",
            " [-3.42527881]\n",
            " [-5.99862065]\n",
            " [-6.46460282]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8787652 ]\n",
            " [-3.42597424]\n",
            " [-5.99914706]\n",
            " [-6.46504957]]\n",
            "i 1367\n",
            "weight1 before iteration:\n",
            " [[ 5.92034161  2.28377816  5.92384201 -3.31702333]\n",
            " [ 5.98511376  1.66613002 -2.15674095  6.26101574]\n",
            " [-1.61783171 -3.14990199 -0.57767101  0.5129541 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92052801  2.28407618  5.92422402 -3.31729364]\n",
            " [ 5.9853093   1.66661489 -2.15700619  6.26135599]\n",
            " [-1.61788824 -3.15054603 -0.57759599  0.51305101]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8787652 ]\n",
            " [-3.42597424]\n",
            " [-5.99914706]\n",
            " [-6.46504957]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.87978964]\n",
            " [-3.42666909]\n",
            " [-5.99967289]\n",
            " [-6.4654958 ]]\n",
            "i 1368\n",
            "weight1 before iteration:\n",
            " [[ 5.92052801  2.28407618  5.92422402 -3.31729364]\n",
            " [ 5.9853093   1.66661489 -2.15700619  6.26135599]\n",
            " [-1.61788824 -3.15054603 -0.57759599  0.51305101]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92071419  2.28437395  5.92460558 -3.31756365]\n",
            " [ 5.98550463  1.66709931 -2.15727114  6.26169584]\n",
            " [-1.61794472 -3.15118943 -0.57752103  0.51314782]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.87978964]\n",
            " [-3.42666909]\n",
            " [-5.99967289]\n",
            " [-6.4654958 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88081304]\n",
            " [-3.42736337]\n",
            " [-6.00019813]\n",
            " [-6.4659415 ]]\n",
            "i 1369\n",
            "weight1 before iteration:\n",
            " [[ 5.92071419  2.28437395  5.92460558 -3.31756365]\n",
            " [ 5.98550463  1.66709931 -2.15727114  6.26169584]\n",
            " [-1.61794472 -3.15118943 -0.57752103  0.51314782]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92090017  2.28467147  5.92498669 -3.31783336]\n",
            " [ 5.98569974  1.66758325 -2.15753581  6.26203529]\n",
            " [-1.61800115 -3.15183219 -0.57744612  0.51324453]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88081304]\n",
            " [-3.42736337]\n",
            " [-6.00019813]\n",
            " [-6.4659415 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.8818354 ]\n",
            " [-3.42805708]\n",
            " [-6.00072279]\n",
            " [-6.46638669]]\n",
            "i 1370\n",
            "weight1 before iteration:\n",
            " [[ 5.92090017  2.28467147  5.92498669 -3.31783336]\n",
            " [ 5.98569974  1.66758325 -2.15753581  6.26203529]\n",
            " [-1.61800115 -3.15183219 -0.57744612  0.51324453]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92108594  2.28496874  5.92536736 -3.31810276]\n",
            " [ 5.98589463  1.66806673 -2.15780019  6.26237434]\n",
            " [-1.61805753 -3.15247433 -0.57737127  0.51334114]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.8818354 ]\n",
            " [-3.42805708]\n",
            " [-6.00072279]\n",
            " [-6.46638669]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88285672]\n",
            " [-3.42875021]\n",
            " [-6.00124687]\n",
            " [-6.46683135]]\n",
            "i 1371\n",
            "weight1 before iteration:\n",
            " [[ 5.92108594  2.28496874  5.92536736 -3.31810276]\n",
            " [ 5.98589463  1.66806673 -2.15780019  6.26237434]\n",
            " [-1.61805753 -3.15247433 -0.57737127  0.51334114]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92127151  2.28526577  5.92574759 -3.31837186]\n",
            " [ 5.9860893   1.66854974 -2.15806428  6.26271299]\n",
            " [-1.61811385 -3.15311582 -0.57729647  0.51343765]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88285672]\n",
            " [-3.42875021]\n",
            " [-6.00124687]\n",
            " [-6.46683135]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88387701]\n",
            " [-3.42944278]\n",
            " [-6.00177037]\n",
            " [-6.4672755 ]]\n",
            "i 1372\n",
            "weight1 before iteration:\n",
            " [[ 5.92127151  2.28526577  5.92574759 -3.31837186]\n",
            " [ 5.9860893   1.66854974 -2.15806428  6.26271299]\n",
            " [-1.61811385 -3.15311582 -0.57729647  0.51343765]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92145686  2.28556255  5.92612737 -3.31864065]\n",
            " [ 5.98628375  1.66903229 -2.1583281   6.26305123]\n",
            " [-1.61817012 -3.15375669 -0.57722173  0.51353406]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88387701]\n",
            " [-3.42944278]\n",
            " [-6.00177037]\n",
            " [-6.4672755 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88489626]\n",
            " [-3.43013477]\n",
            " [-6.00229329]\n",
            " [-6.46771913]]\n",
            "i 1373\n",
            "weight1 before iteration:\n",
            " [[ 5.92145686  2.28556255  5.92612737 -3.31864065]\n",
            " [ 5.98628375  1.66903229 -2.1583281   6.26305123]\n",
            " [-1.61817012 -3.15375669 -0.57722173  0.51353406]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92164202  2.28585908  5.92650671 -3.31890915]\n",
            " [ 5.98647799  1.66951438 -2.15859162  6.26338908]\n",
            " [-1.61822634 -3.15439693 -0.57714704  0.51363037]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88489626]\n",
            " [-3.43013477]\n",
            " [-6.00229329]\n",
            " [-6.46771913]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88591449]\n",
            " [-3.4308262 ]\n",
            " [-6.00281563]\n",
            " [-6.46816223]]\n",
            "i 1374\n",
            "weight1 before iteration:\n",
            " [[ 5.92164202  2.28585908  5.92650671 -3.31890915]\n",
            " [ 5.98647799  1.66951438 -2.15859162  6.26338908]\n",
            " [-1.61822634 -3.15439693 -0.57714704  0.51363037]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92182696  2.28615537  5.92688561 -3.31917734]\n",
            " [ 5.98667202  1.669996   -2.15885487  6.26372653]\n",
            " [-1.61828251 -3.15503653 -0.57707241  0.51372658]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88591449]\n",
            " [-3.4308262 ]\n",
            " [-6.00281563]\n",
            " [-6.46816223]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88693168]\n",
            " [-3.43151706]\n",
            " [-6.0033374 ]\n",
            " [-6.46860483]]\n",
            "i 1375\n",
            "weight1 before iteration:\n",
            " [[ 5.92182696  2.28615537  5.92688561 -3.31917734]\n",
            " [ 5.98667202  1.669996   -2.15885487  6.26372653]\n",
            " [-1.61828251 -3.15503653 -0.57707241  0.51372658]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9220117   2.28645141  5.92726406 -3.31944523]\n",
            " [ 5.98686583  1.67047716 -2.15911783  6.26406358]\n",
            " [-1.61833863 -3.15567551 -0.57699783  0.51382269]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88693168]\n",
            " [-3.43151706]\n",
            " [-6.0033374 ]\n",
            " [-6.46860483]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88794784]\n",
            " [-3.43220735]\n",
            " [-6.0038586 ]\n",
            " [-6.46904691]]\n",
            "i 1376\n",
            "weight1 before iteration:\n",
            " [[ 5.9220117   2.28645141  5.92726406 -3.31944523]\n",
            " [ 5.98686583  1.67047716 -2.15911783  6.26406358]\n",
            " [-1.61833863 -3.15567551 -0.57699783  0.51382269]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92219624  2.28674721  5.92764208 -3.31971282]\n",
            " [ 5.98705942  1.67095786 -2.15938052  6.26440023]\n",
            " [-1.61839469 -3.15631386 -0.57692331  0.5139187 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88794784]\n",
            " [-3.43220735]\n",
            " [-6.0038586 ]\n",
            " [-6.46904691]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88896298]\n",
            " [-3.43289707]\n",
            " [-6.00437921]\n",
            " [-6.46948847]]\n",
            "i 1377\n",
            "weight1 before iteration:\n",
            " [[ 5.92219624  2.28674721  5.92764208 -3.31971282]\n",
            " [ 5.98705942  1.67095786 -2.15938052  6.26440023]\n",
            " [-1.61839469 -3.15631386 -0.57692331  0.5139187 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92238057  2.28704276  5.92801966 -3.31998011]\n",
            " [ 5.9872528   1.67143811 -2.15964292  6.26473649]\n",
            " [-1.61845071 -3.15695159 -0.57684885  0.51401461]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88896298]\n",
            " [-3.43289707]\n",
            " [-6.00437921]\n",
            " [-6.46948847]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.88997709]\n",
            " [-3.43358623]\n",
            " [-6.00489926]\n",
            " [-6.46992952]]\n",
            "i 1378\n",
            "weight1 before iteration:\n",
            " [[ 5.92238057  2.28704276  5.92801966 -3.31998011]\n",
            " [ 5.9872528   1.67143811 -2.15964292  6.26473649]\n",
            " [-1.61845071 -3.15695159 -0.57684885  0.51401461]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9225647   2.28733807  5.92839679 -3.32024711]\n",
            " [ 5.98744597  1.67191789 -2.15990503  6.26507235]\n",
            " [-1.61850667 -3.15758869 -0.57677443  0.51411043]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.88997709]\n",
            " [-3.43358623]\n",
            " [-6.00489926]\n",
            " [-6.46992952]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89099019]\n",
            " [-3.43427483]\n",
            " [-6.00541873]\n",
            " [-6.47037006]]\n",
            "i 1379\n",
            "weight1 before iteration:\n",
            " [[ 5.9225647   2.28733807  5.92839679 -3.32024711]\n",
            " [ 5.98744597  1.67191789 -2.15990503  6.26507235]\n",
            " [-1.61850667 -3.15758869 -0.57677443  0.51411043]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92274863  2.28763313  5.9287735  -3.3205138 ]\n",
            " [ 5.98763892  1.67239721 -2.16016687  6.26540782]\n",
            " [-1.61856258 -3.15822516 -0.57670008  0.51420615]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89099019]\n",
            " [-3.43427483]\n",
            " [-6.00541873]\n",
            " [-6.47037006]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89200226]\n",
            " [-3.43496286]\n",
            " [-6.00593764]\n",
            " [-6.47081009]]\n",
            "i 1380\n",
            "weight1 before iteration:\n",
            " [[ 5.92274863  2.28763313  5.9287735  -3.3205138 ]\n",
            " [ 5.98763892  1.67239721 -2.16016687  6.26540782]\n",
            " [-1.61856258 -3.15822516 -0.57670008  0.51420615]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92293235  2.28792795  5.92914976 -3.3207802 ]\n",
            " [ 5.98783166  1.67287608 -2.16042843  6.2657429 ]\n",
            " [-1.61861844 -3.15886102 -0.57662578  0.51430176]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89200226]\n",
            " [-3.43496286]\n",
            " [-6.00593764]\n",
            " [-6.47081009]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89301331]\n",
            " [-3.43565033]\n",
            " [-6.00645597]\n",
            " [-6.47124961]]\n",
            "i 1381\n",
            "weight1 before iteration:\n",
            " [[ 5.92293235  2.28792795  5.92914976 -3.3207802 ]\n",
            " [ 5.98783166  1.67287608 -2.16042843  6.2657429 ]\n",
            " [-1.61861844 -3.15886102 -0.57662578  0.51430176]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92311587  2.28822253  5.92952559 -3.3210463 ]\n",
            " [ 5.98802419  1.67335448 -2.16068972  6.26607758]\n",
            " [-1.61867425 -3.15949625 -0.57655153  0.51439728]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89301331]\n",
            " [-3.43565033]\n",
            " [-6.00645597]\n",
            " [-6.47124961]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89402335]\n",
            " [-3.43633723]\n",
            " [-6.00697374]\n",
            " [-6.47168862]]\n",
            "i 1382\n",
            "weight1 before iteration:\n",
            " [[ 5.92311587  2.28822253  5.92952559 -3.3210463 ]\n",
            " [ 5.98802419  1.67335448 -2.16068972  6.26607758]\n",
            " [-1.61867425 -3.15949625 -0.57655153  0.51439728]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92329918  2.28851686  5.92990099 -3.3213121 ]\n",
            " [ 5.9882165   1.67383244 -2.16095072  6.26641187]\n",
            " [-1.61873    -3.16013086 -0.57647734  0.51449271]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89402335]\n",
            " [-3.43633723]\n",
            " [-6.00697374]\n",
            " [-6.47168862]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89503237]\n",
            " [-3.43702358]\n",
            " [-6.00749094]\n",
            " [-6.47212713]]\n",
            "i 1383\n",
            "weight1 before iteration:\n",
            " [[ 5.92329918  2.28851686  5.92990099 -3.3213121 ]\n",
            " [ 5.9882165   1.67383244 -2.16095072  6.26641187]\n",
            " [-1.61873    -3.16013086 -0.57647734  0.51449271]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9234823   2.28881095  5.93027595 -3.32157761]\n",
            " [ 5.98840861  1.67430993 -2.16121144  6.26674578]\n",
            " [-1.61878571 -3.16076486 -0.5764032   0.51458803]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89503237]\n",
            " [-3.43702358]\n",
            " [-6.00749094]\n",
            " [-6.47212713]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89604039]\n",
            " [-3.43770937]\n",
            " [-6.00800757]\n",
            " [-6.47256512]]\n",
            "i 1384\n",
            "weight1 before iteration:\n",
            " [[ 5.9234823   2.28881095  5.93027595 -3.32157761]\n",
            " [ 5.98840861  1.67430993 -2.16121144  6.26674578]\n",
            " [-1.61878571 -3.16076486 -0.5764032   0.51458803]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92366521  2.2891048   5.93065048 -3.32184282]\n",
            " [ 5.9886005   1.67478698 -2.16147189  6.26707929]\n",
            " [-1.61884136 -3.16139823 -0.57632912  0.51468326]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89604039]\n",
            " [-3.43770937]\n",
            " [-6.00800757]\n",
            " [-6.47256512]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89704739]\n",
            " [-3.43839459]\n",
            " [-6.00852364]\n",
            " [-6.47300262]]\n",
            "i 1385\n",
            "weight1 before iteration:\n",
            " [[ 5.92366521  2.2891048   5.93065048 -3.32184282]\n",
            " [ 5.9886005   1.67478698 -2.16147189  6.26707929]\n",
            " [-1.61884136 -3.16139823 -0.57632912  0.51468326]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92384793  2.28939841  5.93102458 -3.32210774]\n",
            " [ 5.98879218  1.67526357 -2.16173206  6.26741241]\n",
            " [-1.61889697 -3.16203099 -0.57625509  0.51477839]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89704739]\n",
            " [-3.43839459]\n",
            " [-6.00852364]\n",
            " [-6.47300262]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89805338]\n",
            " [-3.43907926]\n",
            " [-6.00903914]\n",
            " [-6.4734396 ]]\n",
            "i 1386\n",
            "weight1 before iteration:\n",
            " [[ 5.92384793  2.28939841  5.93102458 -3.32210774]\n",
            " [ 5.98879218  1.67526357 -2.16173206  6.26741241]\n",
            " [-1.61889697 -3.16203099 -0.57625509  0.51477839]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92403044  2.28969177  5.93139824 -3.32237236]\n",
            " [ 5.98898365  1.6757397  -2.16199195  6.26774514]\n",
            " [-1.61895252 -3.16266313 -0.57618112  0.51487342]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89805338]\n",
            " [-3.43907926]\n",
            " [-6.00903914]\n",
            " [-6.4734396 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.89905836]\n",
            " [-3.43976337]\n",
            " [-6.00955408]\n",
            " [-6.47387609]]\n",
            "i 1387\n",
            "weight1 before iteration:\n",
            " [[ 5.92403044  2.28969177  5.93139824 -3.32237236]\n",
            " [ 5.98898365  1.6757397  -2.16199195  6.26774514]\n",
            " [-1.61895252 -3.16266313 -0.57618112  0.51487342]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92421275  2.2899849   5.93177148 -3.32263669]\n",
            " [ 5.98917491  1.67621539 -2.16225157  6.26807749]\n",
            " [-1.61900802 -3.16329466 -0.5761072   0.51496836]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.89905836]\n",
            " [-3.43976337]\n",
            " [-6.00955408]\n",
            " [-6.47387609]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90006235]\n",
            " [-3.44044693]\n",
            " [-6.01006846]\n",
            " [-6.47431207]]\n",
            "i 1388\n",
            "weight1 before iteration:\n",
            " [[ 5.92421275  2.2899849   5.93177148 -3.32263669]\n",
            " [ 5.98917491  1.67621539 -2.16225157  6.26807749]\n",
            " [-1.61900802 -3.16329466 -0.5761072   0.51496836]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92439487  2.29027778  5.93214429 -3.32290073]\n",
            " [ 5.98936596  1.67669062 -2.16251091  6.26840944]\n",
            " [-1.61906348 -3.16392558 -0.57603333  0.5150632 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90006235]\n",
            " [-3.44044693]\n",
            " [-6.01006846]\n",
            " [-6.47431207]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90106532]\n",
            " [-3.44112993]\n",
            " [-6.01058228]\n",
            " [-6.47474755]]\n",
            "i 1389\n",
            "weight1 before iteration:\n",
            " [[ 5.92439487  2.29027778  5.93214429 -3.32290073]\n",
            " [ 5.98936596  1.67669062 -2.16251091  6.26840944]\n",
            " [-1.61906348 -3.16392558 -0.57603333  0.5150632 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92457678  2.29057043  5.93251666 -3.32316447]\n",
            " [ 5.9895568   1.6771654  -2.16276998  6.26874102]\n",
            " [-1.61911888 -3.16455588 -0.57595952  0.51515794]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90106532]\n",
            " [-3.44112993]\n",
            " [-6.01058228]\n",
            " [-6.47474755]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9020673 ]\n",
            " [-3.44181237]\n",
            " [-6.01109554]\n",
            " [-6.47518253]]\n",
            "i 1390\n",
            "weight1 before iteration:\n",
            " [[ 5.92457678  2.29057043  5.93251666 -3.32316447]\n",
            " [ 5.9895568   1.6771654  -2.16276998  6.26874102]\n",
            " [-1.61911888 -3.16455588 -0.57595952  0.51515794]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92475849  2.29086283  5.93288861 -3.32342792]\n",
            " [ 5.98974743  1.67763974 -2.16302878  6.2690722 ]\n",
            " [-1.61917423 -3.16518557 -0.57588576  0.51525259]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9020673 ]\n",
            " [-3.44181237]\n",
            " [-6.01109554]\n",
            " [-6.47518253]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90306828]\n",
            " [-3.44249427]\n",
            " [-6.01160824]\n",
            " [-6.47561701]]\n",
            "i 1391\n",
            "weight1 before iteration:\n",
            " [[ 5.92475849  2.29086283  5.93288861 -3.32342792]\n",
            " [ 5.98974743  1.67763974 -2.16302878  6.2690722 ]\n",
            " [-1.61917423 -3.16518557 -0.57588576  0.51525259]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92494001  2.291155    5.93326014 -3.32369108]\n",
            " [ 5.98993786  1.67811362 -2.1632873   6.26940301]\n",
            " [-1.61922953 -3.16581465 -0.57581206  0.51534714]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90306828]\n",
            " [-3.44249427]\n",
            " [-6.01160824]\n",
            " [-6.47561701]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90406826]\n",
            " [-3.4431756 ]\n",
            " [-6.01212039]\n",
            " [-6.47605099]]\n",
            "i 1392\n",
            "weight1 before iteration:\n",
            " [[ 5.92494001  2.291155    5.93326014 -3.32369108]\n",
            " [ 5.98993786  1.67811362 -2.1632873   6.26940301]\n",
            " [-1.61922953 -3.16581465 -0.57581206  0.51534714]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92512133  2.29144693  5.93363124 -3.32395395]\n",
            " [ 5.99012808  1.67858705 -2.16354554  6.26973342]\n",
            " [-1.61928478 -3.16644312 -0.57573841  0.51544159]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90406826]\n",
            " [-3.4431756 ]\n",
            " [-6.01212039]\n",
            " [-6.47605099]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90506724]\n",
            " [-3.44385639]\n",
            " [-6.01263198]\n",
            " [-6.47648447]]\n",
            "i 1393\n",
            "weight1 before iteration:\n",
            " [[ 5.92512133  2.29144693  5.93363124 -3.32395395]\n",
            " [ 5.99012808  1.67858705 -2.16354554  6.26973342]\n",
            " [-1.61928478 -3.16644312 -0.57573841  0.51544159]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92530245  2.29173861  5.93400191 -3.32421654]\n",
            " [ 5.99031808  1.67906004 -2.16380352  6.27006346]\n",
            " [-1.61933998 -3.16707099 -0.57566481  0.51553595]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90506724]\n",
            " [-3.44385639]\n",
            " [-6.01263198]\n",
            " [-6.47648447]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90606523]\n",
            " [-3.44453663]\n",
            " [-6.01314301]\n",
            " [-6.47691746]]\n",
            "i 1394\n",
            "weight1 before iteration:\n",
            " [[ 5.92530245  2.29173861  5.93400191 -3.32421654]\n",
            " [ 5.99031808  1.67906004 -2.16380352  6.27006346]\n",
            " [-1.61933998 -3.16707099 -0.57566481  0.51553595]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92548337  2.29203006  5.93437216 -3.32447883]\n",
            " [ 5.99050789  1.67953258 -2.16406122  6.27039311]\n",
            " [-1.61939513 -3.16769824 -0.57559127  0.51563021]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90606523]\n",
            " [-3.44453663]\n",
            " [-6.01314301]\n",
            " [-6.47691746]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90706223]\n",
            " [-3.44521631]\n",
            " [-6.01365349]\n",
            " [-6.47734996]]\n",
            "i 1395\n",
            "weight1 before iteration:\n",
            " [[ 5.92548337  2.29203006  5.93437216 -3.32447883]\n",
            " [ 5.99050789  1.67953258 -2.16406122  6.27039311]\n",
            " [-1.61939513 -3.16769824 -0.57559127  0.51563021]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92566409  2.29232128  5.93474199 -3.32474083]\n",
            " [ 5.99069748  1.68000468 -2.16431865  6.27072239]\n",
            " [-1.61945023 -3.16832489 -0.57551778  0.51572438]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90706223]\n",
            " [-3.44521631]\n",
            " [-6.01365349]\n",
            " [-6.47734996]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90805824]\n",
            " [-3.44589545]\n",
            " [-6.01416341]\n",
            " [-6.47778196]]\n",
            "i 1396\n",
            "weight1 before iteration:\n",
            " [[ 5.92566409  2.29232128  5.93474199 -3.32474083]\n",
            " [ 5.99069748  1.68000468 -2.16431865  6.27072239]\n",
            " [-1.61945023 -3.16832489 -0.57551778  0.51572438]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92584462  2.29261225  5.93511139 -3.32500254]\n",
            " [ 5.99088687  1.68047633 -2.16457581  6.27105128]\n",
            " [-1.61950528 -3.16895094 -0.57544434  0.51581845]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90805824]\n",
            " [-3.44589545]\n",
            " [-6.01416341]\n",
            " [-6.47778196]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.90905326]\n",
            " [-3.44657403]\n",
            " [-6.01467279]\n",
            " [-6.47821346]]\n",
            "i 1397\n",
            "weight1 before iteration:\n",
            " [[ 5.92584462  2.29261225  5.93511139 -3.32500254]\n",
            " [ 5.99088687  1.68047633 -2.16457581  6.27105128]\n",
            " [-1.61950528 -3.16895094 -0.57544434  0.51581845]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92602496  2.29290299  5.93548037 -3.32526397]\n",
            " [ 5.99107605  1.68094754 -2.1648327   6.27137979]\n",
            " [-1.61956028 -3.16957638 -0.57537096  0.51591243]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.90905326]\n",
            " [-3.44657403]\n",
            " [-6.01467279]\n",
            " [-6.47821346]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9100473 ]\n",
            " [-3.44725207]\n",
            " [-6.01518161]\n",
            " [-6.47864448]]\n",
            "i 1398\n",
            "weight1 before iteration:\n",
            " [[ 5.92602496  2.29290299  5.93548037 -3.32526397]\n",
            " [ 5.99107605  1.68094754 -2.1648327   6.27137979]\n",
            " [-1.61956028 -3.16957638 -0.57537096  0.51591243]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92620509  2.29319349  5.93584894 -3.32552511]\n",
            " [ 5.99126503  1.6814183  -2.16508932  6.27170792]\n",
            " [-1.61961524 -3.17020123 -0.57529763  0.51600631]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9100473 ]\n",
            " [-3.44725207]\n",
            " [-6.01518161]\n",
            " [-6.47864448]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91104035]\n",
            " [-3.44792956]\n",
            " [-6.01568988]\n",
            " [-6.479075  ]]\n",
            "i 1399\n",
            "weight1 before iteration:\n",
            " [[ 5.92620509  2.29319349  5.93584894 -3.32552511]\n",
            " [ 5.99126503  1.6814183  -2.16508932  6.27170792]\n",
            " [-1.61961524 -3.17020123 -0.57529763  0.51600631]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92638503  2.29348375  5.93621708 -3.32578596]\n",
            " [ 5.9914538   1.68188862 -2.16534567  6.27203568]\n",
            " [-1.61967014 -3.17082547 -0.57522436  0.5161001 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91104035]\n",
            " [-3.44792956]\n",
            " [-6.01568988]\n",
            " [-6.479075  ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91203242]\n",
            " [-3.44860651]\n",
            " [-6.01619761]\n",
            " [-6.47950503]]\n",
            "i 1400\n",
            "weight1 before iteration:\n",
            " [[ 5.92638503  2.29348375  5.93621708 -3.32578596]\n",
            " [ 5.9914538   1.68188862 -2.16534567  6.27203568]\n",
            " [-1.61967014 -3.17082547 -0.57522436  0.5161001 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92656478  2.29377378  5.9365848  -3.32604653]\n",
            " [ 5.99164237  1.6823585  -2.16560175  6.27236306]\n",
            " [-1.61972499 -3.17144911 -0.57515113  0.51619379]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91203242]\n",
            " [-3.44860651]\n",
            " [-6.01619761]\n",
            " [-6.47950503]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9130235 ]\n",
            " [-3.44928291]\n",
            " [-6.01670478]\n",
            " [-6.47993458]]\n",
            "i 1401\n",
            "weight1 before iteration:\n",
            " [[ 5.92656478  2.29377378  5.9365848  -3.32604653]\n",
            " [ 5.99164237  1.6823585  -2.16560175  6.27236306]\n",
            " [-1.61972499 -3.17144911 -0.57515113  0.51619379]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92674433  2.29406358  5.93695211 -3.32630681]\n",
            " [ 5.99183073  1.68282793 -2.16585757  6.27269006]\n",
            " [-1.61977979 -3.17207215 -0.57507797  0.51628739]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9130235 ]\n",
            " [-3.44928291]\n",
            " [-6.01670478]\n",
            " [-6.47993458]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91401361]\n",
            " [-3.44995877]\n",
            " [-6.01721141]\n",
            " [-6.48036363]]\n",
            "i 1402\n",
            "weight1 before iteration:\n",
            " [[ 5.92674433  2.29406358  5.93695211 -3.32630681]\n",
            " [ 5.99183073  1.68282793 -2.16585757  6.27269006]\n",
            " [-1.61977979 -3.17207215 -0.57507797  0.51628739]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92692369  2.29435313  5.937319   -3.3265668 ]\n",
            " [ 5.99201889  1.68329693 -2.16611311  6.27301668]\n",
            " [-1.61983455 -3.17269459 -0.57500485  0.51638089]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91401361]\n",
            " [-3.44995877]\n",
            " [-6.01721141]\n",
            " [-6.48036363]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91500274]\n",
            " [-3.45063408]\n",
            " [-6.0177175 ]\n",
            " [-6.4807922 ]]\n",
            "i 1403\n",
            "weight1 before iteration:\n",
            " [[ 5.92692369  2.29435313  5.937319   -3.3265668 ]\n",
            " [ 5.99201889  1.68329693 -2.16611311  6.27301668]\n",
            " [-1.61983455 -3.17269459 -0.57500485  0.51638089]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92710285  2.29464246  5.93768547 -3.32682652]\n",
            " [ 5.99220685  1.68376548 -2.16636839  6.27334293]\n",
            " [-1.61988925 -3.17331643 -0.57493179  0.5164743 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91500274]\n",
            " [-3.45063408]\n",
            " [-6.0177175 ]\n",
            " [-6.4807922 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9159909 ]\n",
            " [-3.45130885]\n",
            " [-6.01822304]\n",
            " [-6.48122028]]\n",
            "i 1404\n",
            "weight1 before iteration:\n",
            " [[ 5.92710285  2.29464246  5.93768547 -3.32682652]\n",
            " [ 5.99220685  1.68376548 -2.16636839  6.27334293]\n",
            " [-1.61988925 -3.17331643 -0.57493179  0.5164743 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92728182  2.29493155  5.93805152 -3.32708594]\n",
            " [ 5.9923946   1.6842336  -2.1666234   6.27366881]\n",
            " [-1.61994391 -3.17393768 -0.57485878  0.51656762]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9159909 ]\n",
            " [-3.45130885]\n",
            " [-6.01822304]\n",
            " [-6.48122028]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91697808]\n",
            " [-3.45198308]\n",
            " [-6.01872804]\n",
            " [-6.48164788]]\n",
            "i 1405\n",
            "weight1 before iteration:\n",
            " [[ 5.92728182  2.29493155  5.93805152 -3.32708594]\n",
            " [ 5.9923946   1.6842336  -2.1666234   6.27366881]\n",
            " [-1.61994391 -3.17393768 -0.57485878  0.51656762]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9274606   2.2952204   5.93841717 -3.32734509]\n",
            " [ 5.99258215  1.68470128 -2.16687815  6.27399431]\n",
            " [-1.61999851 -3.17455834 -0.57478582  0.51666084]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91697808]\n",
            " [-3.45198308]\n",
            " [-6.01872804]\n",
            " [-6.48164788]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91796429]\n",
            " [-3.45265677]\n",
            " [-6.01923249]\n",
            " [-6.48207499]]\n",
            "i 1406\n",
            "weight1 before iteration:\n",
            " [[ 5.9274606   2.2952204   5.93841717 -3.32734509]\n",
            " [ 5.99258215  1.68470128 -2.16687815  6.27399431]\n",
            " [-1.61999851 -3.17455834 -0.57478582  0.51666084]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92763918  2.29550902  5.93878239 -3.32760395]\n",
            " [ 5.99276949  1.68516852 -2.16713263  6.27431944]\n",
            " [-1.62005307 -3.1751784  -0.57471292  0.51675397]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91796429]\n",
            " [-3.45265677]\n",
            " [-6.01923249]\n",
            " [-6.48207499]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.91894953]\n",
            " [-3.45332992]\n",
            " [-6.01973641]\n",
            " [-6.48250162]]\n",
            "i 1407\n",
            "weight1 before iteration:\n",
            " [[ 5.92763918  2.29550902  5.93878239 -3.32760395]\n",
            " [ 5.99276949  1.68516852 -2.16713263  6.27431944]\n",
            " [-1.62005307 -3.1751784  -0.57471292  0.51675397]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92781758  2.29579741  5.93914721 -3.32786253]\n",
            " [ 5.99295664  1.68563533 -2.16738684  6.27464419]\n",
            " [-1.62010758 -3.17579787 -0.57464006  0.516847  ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.91894953]\n",
            " [-3.45332992]\n",
            " [-6.01973641]\n",
            " [-6.48250162]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9199338 ]\n",
            " [-3.45400253]\n",
            " [-6.02023978]\n",
            " [-6.48292777]]\n",
            "i 1408\n",
            "weight1 before iteration:\n",
            " [[ 5.92781758  2.29579741  5.93914721 -3.32786253]\n",
            " [ 5.99295664  1.68563533 -2.16738684  6.27464419]\n",
            " [-1.62010758 -3.17579787 -0.57464006  0.516847  ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92799578  2.29608556  5.93951161 -3.32812083]\n",
            " [ 5.99314358  1.68610169 -2.16764079  6.27496858]\n",
            " [-1.62016204 -3.17641674 -0.57456727  0.51693995]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9199338 ]\n",
            " [-3.45400253]\n",
            " [-6.02023978]\n",
            " [-6.48292777]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92091711]\n",
            " [-3.4546746 ]\n",
            " [-6.02074261]\n",
            " [-6.48335344]]\n",
            "i 1409\n",
            "weight1 before iteration:\n",
            " [[ 5.92799578  2.29608556  5.93951161 -3.32812083]\n",
            " [ 5.99314358  1.68610169 -2.16764079  6.27496858]\n",
            " [-1.62016204 -3.17641674 -0.57456727  0.51693995]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92817378  2.29637349  5.9398756  -3.32837885]\n",
            " [ 5.99333033  1.68656763 -2.16789447  6.27529259]\n",
            " [-1.62021645 -3.17703503 -0.57449452  0.51703279]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92091711]\n",
            " [-3.4546746 ]\n",
            " [-6.02074261]\n",
            " [-6.48335344]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92189945]\n",
            " [-3.45534613]\n",
            " [-6.02124491]\n",
            " [-6.48377862]]\n",
            "i 1410\n",
            "weight1 before iteration:\n",
            " [[ 5.92817378  2.29637349  5.9398756  -3.32837885]\n",
            " [ 5.99333033  1.68656763 -2.16789447  6.27529259]\n",
            " [-1.62021645 -3.17703503 -0.57449452  0.51703279]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9283516   2.29666118  5.94023918 -3.32863659]\n",
            " [ 5.99351687  1.68703313 -2.16814789  6.27561624]\n",
            " [-1.62027081 -3.17765273 -0.57442183  0.51712555]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92189945]\n",
            " [-3.45534613]\n",
            " [-6.02124491]\n",
            " [-6.48377862]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92288083]\n",
            " [-3.45601713]\n",
            " [-6.02174667]\n",
            " [-6.48420333]]\n",
            "i 1411\n",
            "weight1 before iteration:\n",
            " [[ 5.9283516   2.29666118  5.94023918 -3.32863659]\n",
            " [ 5.99351687  1.68703313 -2.16814789  6.27561624]\n",
            " [-1.62027081 -3.17765273 -0.57442183  0.51712555]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92852923  2.29694863  5.94060235 -3.32889404]\n",
            " [ 5.99370321  1.68749819 -2.16840105  6.27593952]\n",
            " [-1.62032512 -3.17826984 -0.57434918  0.51721821]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92288083]\n",
            " [-3.45601713]\n",
            " [-6.02174667]\n",
            " [-6.48420333]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92386124]\n",
            " [-3.45668759]\n",
            " [-6.02224789]\n",
            " [-6.48462756]]\n",
            "i 1412\n",
            "weight1 before iteration:\n",
            " [[ 5.92852923  2.29694863  5.94060235 -3.32889404]\n",
            " [ 5.99370321  1.68749819 -2.16840105  6.27593952]\n",
            " [-1.62032512 -3.17826984 -0.57434918  0.51721821]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92870666  2.29723586  5.94096511 -3.32915122]\n",
            " [ 5.99388935  1.68796282 -2.16865394  6.27626242]\n",
            " [-1.62037939 -3.17888636 -0.57427659  0.51731079]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92386124]\n",
            " [-3.45668759]\n",
            " [-6.02224789]\n",
            " [-6.48462756]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9248407 ]\n",
            " [-3.45735752]\n",
            " [-6.02274858]\n",
            " [-6.48505131]]\n",
            "i 1413\n",
            "weight1 before iteration:\n",
            " [[ 5.92870666  2.29723586  5.94096511 -3.32915122]\n",
            " [ 5.99388935  1.68796282 -2.16865394  6.27626242]\n",
            " [-1.62037939 -3.17888636 -0.57427659  0.51731079]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92888391  2.29752285  5.94132747 -3.32940812]\n",
            " [ 5.9940753   1.68842702 -2.16890658  6.27658496]\n",
            " [-1.6204336  -3.17950229 -0.57420406  0.51740327]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9248407 ]\n",
            " [-3.45735752]\n",
            " [-6.02274858]\n",
            " [-6.48505131]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9258192 ]\n",
            " [-3.45802691]\n",
            " [-6.02324873]\n",
            " [-6.48547458]]\n",
            "i 1414\n",
            "weight1 before iteration:\n",
            " [[ 5.92888391  2.29752285  5.94132747 -3.32940812]\n",
            " [ 5.9940753   1.68842702 -2.16890658  6.27658496]\n",
            " [-1.6204336  -3.17950229 -0.57420406  0.51740327]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92906096  2.29780962  5.94168941 -3.32966474]\n",
            " [ 5.99426104  1.68889079 -2.16915895  6.27690714]\n",
            " [-1.62048777 -3.18011764 -0.57413157  0.51749565]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9258192 ]\n",
            " [-3.45802691]\n",
            " [-6.02324873]\n",
            " [-6.48547458]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92679674]\n",
            " [-3.45869577]\n",
            " [-6.02374835]\n",
            " [-6.48589738]]\n",
            "i 1415\n",
            "weight1 before iteration:\n",
            " [[ 5.92906096  2.29780962  5.94168941 -3.32966474]\n",
            " [ 5.99426104  1.68889079 -2.16915895  6.27690714]\n",
            " [-1.62048777 -3.18011764 -0.57413157  0.51749565]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92923783  2.29809615  5.94205095 -3.32992109]\n",
            " [ 5.99444658  1.68935413 -2.16941106  6.27722894]\n",
            " [-1.62054189 -3.18073241 -0.57405914  0.51758795]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92679674]\n",
            " [-3.45869577]\n",
            " [-6.02374835]\n",
            " [-6.48589738]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92777333]\n",
            " [-3.45936409]\n",
            " [-6.02424744]\n",
            " [-6.48631971]]\n",
            "i 1416\n",
            "weight1 before iteration:\n",
            " [[ 5.92923783  2.29809615  5.94205095 -3.32992109]\n",
            " [ 5.99444658  1.68935413 -2.16941106  6.27722894]\n",
            " [-1.62054189 -3.18073241 -0.57405914  0.51758795]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92941451  2.29838246  5.94241209 -3.33017716]\n",
            " [ 5.99463193  1.68981703 -2.16966291  6.27755039]\n",
            " [-1.62059597 -3.18134659 -0.57398676  0.51768015]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92777333]\n",
            " [-3.45936409]\n",
            " [-6.02424744]\n",
            " [-6.48631971]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92874897]\n",
            " [-3.46003188]\n",
            " [-6.024746  ]\n",
            " [-6.48674156]]\n",
            "i 1417\n",
            "weight1 before iteration:\n",
            " [[ 5.92941451  2.29838246  5.94241209 -3.33017716]\n",
            " [ 5.99463193  1.68981703 -2.16966291  6.27755039]\n",
            " [-1.62059597 -3.18134659 -0.57398676  0.51768015]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.929591    2.29866853  5.94277282 -3.33043295]\n",
            " [ 5.99481708  1.69027951 -2.16991449  6.27787146]\n",
            " [-1.62064999 -3.18196019 -0.57391443  0.51777226]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92874897]\n",
            " [-3.46003188]\n",
            " [-6.024746  ]\n",
            " [-6.48674156]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.92972366]\n",
            " [-3.46069915]\n",
            " [-6.02524402]\n",
            " [-6.48716294]]\n",
            "i 1418\n",
            "weight1 before iteration:\n",
            " [[ 5.929591    2.29866853  5.94277282 -3.33043295]\n",
            " [ 5.99481708  1.69027951 -2.16991449  6.27787146]\n",
            " [-1.62064999 -3.18196019 -0.57391443  0.51777226]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9297673   2.29895438  5.94313314 -3.33068846]\n",
            " [ 5.99500203  1.69074156 -2.17016582  6.27819218]\n",
            " [-1.62070397 -3.18257321 -0.57384215  0.51786428]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.92972366]\n",
            " [-3.46069915]\n",
            " [-6.02524402]\n",
            " [-6.48716294]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9306974 ]\n",
            " [-3.46136588]\n",
            " [-6.02574152]\n",
            " [-6.48758384]]\n",
            "i 1419\n",
            "weight1 before iteration:\n",
            " [[ 5.9297673   2.29895438  5.94313314 -3.33068846]\n",
            " [ 5.99500203  1.69074156 -2.17016582  6.27819218]\n",
            " [-1.62070397 -3.18257321 -0.57384215  0.51786428]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.92994341  2.29923999  5.94349307 -3.3309437 ]\n",
            " [ 5.99518678  1.69120318 -2.17041689  6.27851253]\n",
            " [-1.62075789 -3.18318565 -0.57376993  0.51795621]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9306974 ]\n",
            " [-3.46136588]\n",
            " [-6.02574152]\n",
            " [-6.48758384]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93167019]\n",
            " [-3.46203208]\n",
            " [-6.02623849]\n",
            " [-6.48800428]]\n",
            "i 1420\n",
            "weight1 before iteration:\n",
            " [[ 5.92994341  2.29923999  5.94349307 -3.3309437 ]\n",
            " [ 5.99518678  1.69120318 -2.17041689  6.27851253]\n",
            " [-1.62075789 -3.18318565 -0.57376993  0.51795621]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93011934  2.29952538  5.94385258 -3.33119866]\n",
            " [ 5.99537134  1.69166437 -2.1706677   6.27883252]\n",
            " [-1.62081177 -3.18379751 -0.57369776  0.51804805]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93167019]\n",
            " [-3.46203208]\n",
            " [-6.02623849]\n",
            " [-6.48800428]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93264203]\n",
            " [-3.46269776]\n",
            " [-6.02673494]\n",
            " [-6.48842425]]\n",
            "i 1421\n",
            "weight1 before iteration:\n",
            " [[ 5.93011934  2.29952538  5.94385258 -3.33119866]\n",
            " [ 5.99537134  1.69166437 -2.1706677   6.27883252]\n",
            " [-1.62081177 -3.18379751 -0.57369776  0.51804805]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93029507  2.29981054  5.9442117  -3.33145335]\n",
            " [ 5.9955557   1.69212514 -2.17091825  6.27915214]\n",
            " [-1.62086561 -3.18440879 -0.57362564  0.51813979]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93264203]\n",
            " [-3.46269776]\n",
            " [-6.02673494]\n",
            " [-6.48842425]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93361293]\n",
            " [-3.46336291]\n",
            " [-6.02723085]\n",
            " [-6.48884374]]\n",
            "i 1422\n",
            "weight1 before iteration:\n",
            " [[ 5.93029507  2.29981054  5.9442117  -3.33145335]\n",
            " [ 5.9955557   1.69212514 -2.17091825  6.27915214]\n",
            " [-1.62086561 -3.18440879 -0.57362564  0.51813979]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93047063  2.30009547  5.94457042 -3.33170777]\n",
            " [ 5.99573986  1.69258548 -2.17116855  6.27947141]\n",
            " [-1.62091939 -3.18501949 -0.57355357  0.51823145]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93361293]\n",
            " [-3.46336291]\n",
            " [-6.02723085]\n",
            " [-6.48884374]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93458289]\n",
            " [-3.46402753]\n",
            " [-6.02772625]\n",
            " [-6.48926277]]\n",
            "i 1423\n",
            "weight1 before iteration:\n",
            " [[ 5.93047063  2.30009547  5.94457042 -3.33170777]\n",
            " [ 5.99573986  1.69258548 -2.17116855  6.27947141]\n",
            " [-1.62091939 -3.18501949 -0.57355357  0.51823145]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93064599  2.30038017  5.94492874 -3.33196191]\n",
            " [ 5.99592383  1.6930454  -2.17141858  6.27979031]\n",
            " [-1.62097313 -3.18562962 -0.57348155  0.51832301]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93458289]\n",
            " [-3.46402753]\n",
            " [-6.02772625]\n",
            " [-6.48926277]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93555191]\n",
            " [-3.46469162]\n",
            " [-6.02822112]\n",
            " [-6.48968134]]\n",
            "i 1424\n",
            "weight1 before iteration:\n",
            " [[ 5.93064599  2.30038017  5.94492874 -3.33196191]\n",
            " [ 5.99592383  1.6930454  -2.17141858  6.27979031]\n",
            " [-1.62097313 -3.18562962 -0.57348155  0.51832301]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93082117  2.30066465  5.94528665 -3.33221578]\n",
            " [ 5.9961076   1.69350489 -2.17166836  6.28010886]\n",
            " [-1.62102682 -3.18623918 -0.57340958  0.51841449]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93555191]\n",
            " [-3.46469162]\n",
            " [-6.02822112]\n",
            " [-6.48968134]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93651999]\n",
            " [-3.46535519]\n",
            " [-6.02871546]\n",
            " [-6.49009943]]\n",
            "i 1425\n",
            "weight1 before iteration:\n",
            " [[ 5.93082117  2.30066465  5.94528665 -3.33221578]\n",
            " [ 5.9961076   1.69350489 -2.17166836  6.28010886]\n",
            " [-1.62102682 -3.18623918 -0.57340958  0.51841449]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93099616  2.3009489   5.94564417 -3.33246938]\n",
            " [ 5.99629118  1.69396396 -2.17191789  6.28042704]\n",
            " [-1.62108046 -3.18684816 -0.57333766  0.51850587]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93651999]\n",
            " [-3.46535519]\n",
            " [-6.02871546]\n",
            " [-6.49009943]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93748714]\n",
            " [-3.46601824]\n",
            " [-6.02920929]\n",
            " [-6.49051706]]\n",
            "i 1426\n",
            "weight1 before iteration:\n",
            " [[ 5.93099616  2.3009489   5.94564417 -3.33246938]\n",
            " [ 5.99629118  1.69396396 -2.17191789  6.28042704]\n",
            " [-1.62108046 -3.18684816 -0.57333766  0.51850587]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93117097  2.30123292  5.9460013  -3.3327227 ]\n",
            " [ 5.99647456  1.69442261 -2.17216715  6.28074487]\n",
            " [-1.62113406 -3.18745657 -0.5732658   0.51859717]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93748714]\n",
            " [-3.46601824]\n",
            " [-6.02920929]\n",
            " [-6.49051706]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93845335]\n",
            " [-3.46668076]\n",
            " [-6.02970259]\n",
            " [-6.49093423]]\n",
            "i 1427\n",
            "weight1 before iteration:\n",
            " [[ 5.93117097  2.30123292  5.9460013  -3.3327227 ]\n",
            " [ 5.99647456  1.69442261 -2.17216715  6.28074487]\n",
            " [-1.62113406 -3.18745657 -0.5732658   0.51859717]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93134559  2.30151672  5.94635802 -3.33297576]\n",
            " [ 5.99665775  1.69488083 -2.17241617  6.28106234]\n",
            " [-1.62118761 -3.1880644  -0.57319399  0.51868837]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93845335]\n",
            " [-3.46668076]\n",
            " [-6.02970259]\n",
            " [-6.49093423]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.93941862]\n",
            " [-3.46734276]\n",
            " [-6.03019537]\n",
            " [-6.49135093]]\n",
            "i 1428\n",
            "weight1 before iteration:\n",
            " [[ 5.93134559  2.30151672  5.94635802 -3.33297576]\n",
            " [ 5.99665775  1.69488083 -2.17241617  6.28106234]\n",
            " [-1.62118761 -3.1880644  -0.57319399  0.51868837]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93152003  2.30180029  5.94671435 -3.33322854]\n",
            " [ 5.99684074  1.69533863 -2.17266492  6.28137946]\n",
            " [-1.62124111 -3.18867167 -0.57312223  0.51877949]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.93941862]\n",
            " [-3.46734276]\n",
            " [-6.03019537]\n",
            " [-6.49135093]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94038296]\n",
            " [-3.46800423]\n",
            " [-6.03068763]\n",
            " [-6.49176718]]\n",
            "i 1429\n",
            "weight1 before iteration:\n",
            " [[ 5.93152003  2.30180029  5.94671435 -3.33322854]\n",
            " [ 5.99684074  1.69533863 -2.17266492  6.28137946]\n",
            " [-1.62124111 -3.18867167 -0.57312223  0.51877949]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93169428  2.30208363  5.94707028 -3.33348105]\n",
            " [ 5.99702355  1.69579601 -2.17291343  6.28169622]\n",
            " [-1.62129456 -3.18927836 -0.57305052  0.51887051]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94038296]\n",
            " [-3.46800423]\n",
            " [-6.03068763]\n",
            " [-6.49176718]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94134638]\n",
            " [-3.46866519]\n",
            " [-6.03117938]\n",
            " [-6.49218296]]\n",
            "i 1430\n",
            "weight1 before iteration:\n",
            " [[ 5.93169428  2.30208363  5.94707028 -3.33348105]\n",
            " [ 5.99702355  1.69579601 -2.17291343  6.28169622]\n",
            " [-1.62129456 -3.18927836 -0.57305052  0.51887051]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93186835  2.30236675  5.94742582 -3.3337333 ]\n",
            " [ 5.99720615  1.69625298 -2.17316167  6.28201262]\n",
            " [-1.62134797 -3.18988449 -0.57297886  0.51896145]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94134638]\n",
            " [-3.46866519]\n",
            " [-6.03117938]\n",
            " [-6.49218296]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94230886]\n",
            " [-3.46932562]\n",
            " [-6.03167061]\n",
            " [-6.49259828]]\n",
            "i 1431\n",
            "weight1 before iteration:\n",
            " [[ 5.93186835  2.30236675  5.94742582 -3.3337333 ]\n",
            " [ 5.99720615  1.69625298 -2.17316167  6.28201262]\n",
            " [-1.62134797 -3.18988449 -0.57297886  0.51896145]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93204224  2.30264965  5.94778097 -3.33398527]\n",
            " [ 5.99738857  1.69670952 -2.17340967  6.28232867]\n",
            " [-1.62140133 -3.19049005 -0.57290725  0.51905229]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94230886]\n",
            " [-3.46932562]\n",
            " [-6.03167061]\n",
            " [-6.49259828]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94327042]\n",
            " [-3.46998554]\n",
            " [-6.03216132]\n",
            " [-6.49301314]]\n",
            "i 1432\n",
            "weight1 before iteration:\n",
            " [[ 5.93204224  2.30264965  5.94778097 -3.33398527]\n",
            " [ 5.99738857  1.69670952 -2.17340967  6.28232867]\n",
            " [-1.62140133 -3.19049005 -0.57290725  0.51905229]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93221594  2.30293232  5.94813572 -3.33423698]\n",
            " [ 5.99757079  1.69716564 -2.17365741  6.28264436]\n",
            " [-1.62145464 -3.19109504 -0.57283569  0.51914305]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94327042]\n",
            " [-3.46998554]\n",
            " [-6.03216132]\n",
            " [-6.49301314]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94423105]\n",
            " [-3.47064493]\n",
            " [-6.03265152]\n",
            " [-6.49342754]]\n",
            "i 1433\n",
            "weight1 before iteration:\n",
            " [[ 5.93221594  2.30293232  5.94813572 -3.33423698]\n",
            " [ 5.99757079  1.69716564 -2.17365741  6.28264436]\n",
            " [-1.62145464 -3.19109504 -0.57283569  0.51914305]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93238946  2.30321477  5.94849008 -3.33448842]\n",
            " [ 5.99775283  1.69762135 -2.1739049   6.28295971]\n",
            " [-1.62150791 -3.19169946 -0.57276418  0.51923372]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94423105]\n",
            " [-3.47064493]\n",
            " [-6.03265152]\n",
            " [-6.49342754]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94519076]\n",
            " [-3.47130381]\n",
            " [-6.0331412 ]\n",
            " [-6.49384148]]\n",
            "i 1434\n",
            "weight1 before iteration:\n",
            " [[ 5.93238946  2.30321477  5.94849008 -3.33448842]\n",
            " [ 5.99775283  1.69762135 -2.1739049   6.28295971]\n",
            " [-1.62150791 -3.19169946 -0.57276418  0.51923372]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9325628   2.30349699  5.94884405 -3.33473959]\n",
            " [ 5.99793467  1.69807664 -2.17415214  6.2832747 ]\n",
            " [-1.62156113 -3.19230332 -0.57269273  0.5193243 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94519076]\n",
            " [-3.47130381]\n",
            " [-6.0331412 ]\n",
            " [-6.49384148]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94614955]\n",
            " [-3.47196217]\n",
            " [-6.03363037]\n",
            " [-6.49425497]]\n",
            "i 1435\n",
            "weight1 before iteration:\n",
            " [[ 5.9325628   2.30349699  5.94884405 -3.33473959]\n",
            " [ 5.99793467  1.69807664 -2.17415214  6.2832747 ]\n",
            " [-1.62156113 -3.19230332 -0.57269273  0.5193243 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93273596  2.30377899  5.94919762 -3.33499049]\n",
            " [ 5.99811631  1.69853151 -2.17439912  6.28358933]\n",
            " [-1.6216143  -3.19290662 -0.57262132  0.51941479]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94614955]\n",
            " [-3.47196217]\n",
            " [-6.03363037]\n",
            " [-6.49425497]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94710742]\n",
            " [-3.47262002]\n",
            " [-6.03411903]\n",
            " [-6.494668  ]]\n",
            "i 1436\n",
            "weight1 before iteration:\n",
            " [[ 5.93273596  2.30377899  5.94919762 -3.33499049]\n",
            " [ 5.99811631  1.69853151 -2.17439912  6.28358933]\n",
            " [-1.6216143  -3.19290662 -0.57262132  0.51941479]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93290893  2.30406077  5.94955081 -3.33524113]\n",
            " [ 5.99829777  1.69898596 -2.17464586  6.28390362]\n",
            " [-1.62166743 -3.19350936 -0.57254997  0.51950519]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94710742]\n",
            " [-3.47262002]\n",
            " [-6.03411903]\n",
            " [-6.494668  ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94806437]\n",
            " [-3.47327735]\n",
            " [-6.03460718]\n",
            " [-6.49508058]]\n",
            "i 1437\n",
            "weight1 before iteration:\n",
            " [[ 5.93290893  2.30406077  5.94955081 -3.33524113]\n",
            " [ 5.99829777  1.69898596 -2.17464586  6.28390362]\n",
            " [-1.62166743 -3.19350936 -0.57254997  0.51950519]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93308172  2.30434232  5.94990361 -3.3354915 ]\n",
            " [ 5.99847904  1.69944    -2.17489234  6.28421756]\n",
            " [-1.62172051 -3.19411153 -0.57247866  0.5195955 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94806437]\n",
            " [-3.47327735]\n",
            " [-6.03460718]\n",
            " [-6.49508058]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9490204 ]\n",
            " [-3.47393416]\n",
            " [-6.03509481]\n",
            " [-6.4954927 ]]\n",
            "i 1438\n",
            "weight1 before iteration:\n",
            " [[ 5.93308172  2.30434232  5.94990361 -3.3354915 ]\n",
            " [ 5.99847904  1.69944    -2.17489234  6.28421756]\n",
            " [-1.62172051 -3.19411153 -0.57247866  0.5195955 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93325434  2.30462365  5.95025602 -3.3357416 ]\n",
            " [ 5.99866012  1.69989363 -2.17513858  6.28453114]\n",
            " [-1.62177354 -3.19471314 -0.57240741  0.51968573]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9490204 ]\n",
            " [-3.47393416]\n",
            " [-6.03509481]\n",
            " [-6.4954927 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.94997551]\n",
            " [-3.47459046]\n",
            " [-6.03558194]\n",
            " [-6.49590437]]\n",
            "i 1439\n",
            "weight1 before iteration:\n",
            " [[ 5.93325434  2.30462365  5.95025602 -3.3357416 ]\n",
            " [ 5.99866012  1.69989363 -2.17513858  6.28453114]\n",
            " [-1.62177354 -3.19471314 -0.57240741  0.51968573]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93342677  2.30490476  5.95060804 -3.33599144]\n",
            " [ 5.998841    1.70034684 -2.17538456  6.28484438]\n",
            " [-1.62182653 -3.19531419 -0.5723362   0.51977587]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.94997551]\n",
            " [-3.47459046]\n",
            " [-6.03558194]\n",
            " [-6.49590437]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95092972]\n",
            " [-3.47524625]\n",
            " [-6.03606856]\n",
            " [-6.49631558]]\n",
            "i 1440\n",
            "weight1 before iteration:\n",
            " [[ 5.93342677  2.30490476  5.95060804 -3.33599144]\n",
            " [ 5.998841    1.70034684 -2.17538456  6.28484438]\n",
            " [-1.62182653 -3.19531419 -0.5723362   0.51977587]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93359902  2.30518565  5.95095968 -3.33624102]\n",
            " [ 5.9990217   1.70079964 -2.1756303   6.28515727]\n",
            " [-1.62187947 -3.19591468 -0.57226505  0.51986592]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95092972]\n",
            " [-3.47524625]\n",
            " [-6.03606856]\n",
            " [-6.49631558]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95188301]\n",
            " [-3.47590152]\n",
            " [-6.03655467]\n",
            " [-6.49672635]]\n",
            "i 1441\n",
            "weight1 before iteration:\n",
            " [[ 5.93359902  2.30518565  5.95095968 -3.33624102]\n",
            " [ 5.9990217   1.70079964 -2.1756303   6.28515727]\n",
            " [-1.62187947 -3.19591468 -0.57226505  0.51986592]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93377109  2.30546632  5.95131093 -3.33649033]\n",
            " [ 5.99920221  1.70125203 -2.17587578  6.28546981]\n",
            " [-1.62193237 -3.19651462 -0.57219395  0.51995588]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95188301]\n",
            " [-3.47590152]\n",
            " [-6.03655467]\n",
            " [-6.49672635]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95283539]\n",
            " [-3.47655629]\n",
            " [-6.03704028]\n",
            " [-6.49713666]]\n",
            "i 1442\n",
            "weight1 before iteration:\n",
            " [[ 5.93377109  2.30546632  5.95131093 -3.33649033]\n",
            " [ 5.99920221  1.70125203 -2.17587578  6.28546981]\n",
            " [-1.62193237 -3.19651462 -0.57219395  0.51995588]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93394298  2.30574676  5.95166179 -3.33673938]\n",
            " [ 5.99938253  1.70170401 -2.17612102  6.28578201]\n",
            " [-1.62198522 -3.197114   -0.57212289  0.52004575]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95283539]\n",
            " [-3.47655629]\n",
            " [-6.03704028]\n",
            " [-6.49713666]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95378686]\n",
            " [-3.47721054]\n",
            " [-6.03752538]\n",
            " [-6.49754653]]\n",
            "i 1443\n",
            "weight1 before iteration:\n",
            " [[ 5.93394298  2.30574676  5.95166179 -3.33673938]\n",
            " [ 5.99938253  1.70170401 -2.17612102  6.28578201]\n",
            " [-1.62198522 -3.197114   -0.57212289  0.52004575]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93411469  2.30602699  5.95201227 -3.33698817]\n",
            " [ 5.99956266  1.70215557 -2.17636601  6.28609386]\n",
            " [-1.62203802 -3.19771282 -0.57205189  0.52013554]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95378686]\n",
            " [-3.47721054]\n",
            " [-6.03752538]\n",
            " [-6.49754653]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95473743]\n",
            " [-3.47786428]\n",
            " [-6.03800997]\n",
            " [-6.49795594]]\n",
            "i 1444\n",
            "weight1 before iteration:\n",
            " [[ 5.93411469  2.30602699  5.95201227 -3.33698817]\n",
            " [ 5.99956266  1.70215557 -2.17636601  6.28609386]\n",
            " [-1.62203802 -3.19771282 -0.57205189  0.52013554]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93428622  2.30630699  5.95236236 -3.33723669]\n",
            " [ 5.99974261  1.70260673 -2.17661075  6.28640536]\n",
            " [-1.62209078 -3.19831109 -0.57198094  0.52022524]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95473743]\n",
            " [-3.47786428]\n",
            " [-6.03800997]\n",
            " [-6.49795594]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95568709]\n",
            " [-3.47851751]\n",
            " [-6.03849406]\n",
            " [-6.49836491]]\n",
            "i 1445\n",
            "weight1 before iteration:\n",
            " [[ 5.93428622  2.30630699  5.95236236 -3.33723669]\n",
            " [ 5.99974261  1.70260673 -2.17661075  6.28640536]\n",
            " [-1.62209078 -3.19831109 -0.57198094  0.52022524]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93445757  2.30658678  5.95271208 -3.33748495]\n",
            " [ 5.99992236  1.70305747 -2.17685525  6.28671652]\n",
            " [-1.62214349 -3.1989088  -0.57191004  0.52031485]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95568709]\n",
            " [-3.47851751]\n",
            " [-6.03849406]\n",
            " [-6.49836491]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95663584]\n",
            " [-3.47917024]\n",
            " [-6.03897765]\n",
            " [-6.49877343]]\n",
            "i 1446\n",
            "weight1 before iteration:\n",
            " [[ 5.93445757  2.30658678  5.95271208 -3.33748495]\n",
            " [ 5.99992236  1.70305747 -2.17685525  6.28671652]\n",
            " [-1.62214349 -3.1989088  -0.57191004  0.52031485]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93462875  2.30686634  5.95306141 -3.33773295]\n",
            " [ 6.00010193  1.70350781 -2.1770995   6.28702734]\n",
            " [-1.62219616 -3.19950596 -0.57183918  0.52040438]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95663584]\n",
            " [-3.47917024]\n",
            " [-6.03897765]\n",
            " [-6.49877343]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9575837 ]\n",
            " [-3.47982245]\n",
            " [-6.03946074]\n",
            " [-6.49918151]]\n",
            "i 1447\n",
            "weight1 before iteration:\n",
            " [[ 5.93462875  2.30686634  5.95306141 -3.33773295]\n",
            " [ 6.00010193  1.70350781 -2.1770995   6.28702734]\n",
            " [-1.62219616 -3.19950596 -0.57183918  0.52040438]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93479975  2.30714569  5.95341035 -3.33798069]\n",
            " [ 6.00028131  1.70395773 -2.1773435   6.28733781]\n",
            " [-1.62224878 -3.20010257 -0.57176838  0.52049382]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9575837 ]\n",
            " [-3.47982245]\n",
            " [-6.03946074]\n",
            " [-6.49918151]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95853065]\n",
            " [-3.48047416]\n",
            " [-6.03994332]\n",
            " [-6.49958914]]\n",
            "i 1448\n",
            "weight1 before iteration:\n",
            " [[ 5.93479975  2.30714569  5.95341035 -3.33798069]\n",
            " [ 6.00028131  1.70395773 -2.1773435   6.28733781]\n",
            " [-1.62224878 -3.20010257 -0.57176838  0.52049382]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93497057  2.30742482  5.95375892 -3.33822817]\n",
            " [ 6.00046051  1.70440725 -2.17758726  6.28764794]\n",
            " [-1.62230135 -3.20069862 -0.57169763  0.52058317]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95853065]\n",
            " [-3.48047416]\n",
            " [-6.03994332]\n",
            " [-6.49958914]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.95947671]\n",
            " [-3.48112536]\n",
            " [-6.04042541]\n",
            " [-6.49999632]]\n",
            "i 1449\n",
            "weight1 before iteration:\n",
            " [[ 5.93497057  2.30742482  5.95375892 -3.33822817]\n",
            " [ 6.00046051  1.70440725 -2.17758726  6.28764794]\n",
            " [-1.62230135 -3.20069862 -0.57169763  0.52058317]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93514121  2.30770373  5.95410711 -3.33847539]\n",
            " [ 6.00063952  1.70485637 -2.17783077  6.28795772]\n",
            " [-1.62235388 -3.20129413 -0.57162692  0.52067243]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.95947671]\n",
            " [-3.48112536]\n",
            " [-6.04042541]\n",
            " [-6.49999632]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96042186]\n",
            " [-3.48177606]\n",
            " [-6.040907  ]\n",
            " [-6.50040306]]\n",
            "i 1450\n",
            "weight1 before iteration:\n",
            " [[ 5.93514121  2.30770373  5.95410711 -3.33847539]\n",
            " [ 6.00063952  1.70485637 -2.17783077  6.28795772]\n",
            " [-1.62235388 -3.20129413 -0.57162692  0.52067243]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93531167  2.30798242  5.95445491 -3.33872234]\n",
            " [ 6.00081834  1.70530507 -2.17807404  6.28826717]\n",
            " [-1.62240637 -3.20188909 -0.57155627  0.52076161]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96042186]\n",
            " [-3.48177606]\n",
            " [-6.040907  ]\n",
            " [-6.50040306]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96136612]\n",
            " [-3.48242625]\n",
            " [-6.04138809]\n",
            " [-6.50080936]]\n",
            "i 1451\n",
            "weight1 before iteration:\n",
            " [[ 5.93531167  2.30798242  5.95445491 -3.33872234]\n",
            " [ 6.00081834  1.70530507 -2.17807404  6.28826717]\n",
            " [-1.62240637 -3.20188909 -0.57155627  0.52076161]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93548196  2.30826089  5.95480234 -3.33896904]\n",
            " [ 6.00099698  1.70575338 -2.17831706  6.28857627]\n",
            " [-1.62245881 -3.2024835  -0.57148567  0.52085071]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96136612]\n",
            " [-3.48242625]\n",
            " [-6.04138809]\n",
            " [-6.50080936]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96230949]\n",
            " [-3.48307594]\n",
            " [-6.04186868]\n",
            " [-6.50121522]]\n",
            "i 1452\n",
            "weight1 before iteration:\n",
            " [[ 5.93548196  2.30826089  5.95480234 -3.33896904]\n",
            " [ 6.00099698  1.70575338 -2.17831706  6.28857627]\n",
            " [-1.62245881 -3.2024835  -0.57148567  0.52085071]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93565207  2.30853914  5.95514939 -3.33921549]\n",
            " [ 6.00117543  1.70620127 -2.17855984  6.28888504]\n",
            " [-1.6225112  -3.20307736 -0.57141511  0.52093972]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96230949]\n",
            " [-3.48307594]\n",
            " [-6.04186868]\n",
            " [-6.50121522]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96325197]\n",
            " [-3.48372512]\n",
            " [-6.04234877]\n",
            " [-6.50162063]]\n",
            "i 1453\n",
            "weight1 before iteration:\n",
            " [[ 5.93565207  2.30853914  5.95514939 -3.33921549]\n",
            " [ 6.00117543  1.70620127 -2.17855984  6.28888504]\n",
            " [-1.6225112  -3.20307736 -0.57141511  0.52093972]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93582201  2.30881718  5.95549607 -3.33946167]\n",
            " [ 6.0013537   1.70664877 -2.17880238  6.28919346]\n",
            " [-1.62256355 -3.20367068 -0.5713446   0.52102864]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96325197]\n",
            " [-3.48372512]\n",
            " [-6.04234877]\n",
            " [-6.50162063]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96419355]\n",
            " [-3.48437381]\n",
            " [-6.04282837]\n",
            " [-6.50202561]]\n",
            "i 1454\n",
            "weight1 before iteration:\n",
            " [[ 5.93582201  2.30881718  5.95549607 -3.33946167]\n",
            " [ 6.0013537   1.70664877 -2.17880238  6.28919346]\n",
            " [-1.62256355 -3.20367068 -0.5713446   0.52102864]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93599177  2.309095    5.95584236 -3.3397076 ]\n",
            " [ 6.00153178  1.70709585 -2.17904467  6.28950155]\n",
            " [-1.62261585 -3.20426345 -0.57127415  0.52111747]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96419355]\n",
            " [-3.48437381]\n",
            " [-6.04282837]\n",
            " [-6.50202561]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96513424]\n",
            " [-3.48502199]\n",
            " [-6.04330748]\n",
            " [-6.50243015]]\n",
            "i 1455\n",
            "weight1 before iteration:\n",
            " [[ 5.93599177  2.309095    5.95584236 -3.3397076 ]\n",
            " [ 6.00153178  1.70709585 -2.17904467  6.28950155]\n",
            " [-1.62261585 -3.20426345 -0.57127415  0.52111747]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93616135  2.3093726   5.95618829 -3.33995327]\n",
            " [ 6.00170968  1.70754254 -2.17928672  6.28980929]\n",
            " [-1.62266811 -3.20485567 -0.57120374  0.52120622]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96513424]\n",
            " [-3.48502199]\n",
            " [-6.04330748]\n",
            " [-6.50243015]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96607405]\n",
            " [-3.48566967]\n",
            " [-6.04378609]\n",
            " [-6.50283424]]\n",
            "i 1456\n",
            "weight1 before iteration:\n",
            " [[ 5.93616135  2.3093726   5.95618829 -3.33995327]\n",
            " [ 6.00170968  1.70754254 -2.17928672  6.28980929]\n",
            " [-1.62266811 -3.20485567 -0.57120374  0.52120622]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93633076  2.30964999  5.95653383 -3.34019868]\n",
            " [ 6.0018874   1.70798882 -2.17952853  6.2901167 ]\n",
            " [-1.62272033 -3.20544735 -0.57113338  0.52129489]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96607405]\n",
            " [-3.48566967]\n",
            " [-6.04378609]\n",
            " [-6.50283424]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96701297]\n",
            " [-3.48631684]\n",
            " [-6.04426421]\n",
            " [-6.5032379 ]]\n",
            "i 1457\n",
            "weight1 before iteration:\n",
            " [[ 5.93633076  2.30964999  5.95653383 -3.34019868]\n",
            " [ 6.0018874   1.70798882 -2.17952853  6.2901167 ]\n",
            " [-1.62272033 -3.20544735 -0.57113338  0.52129489]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9365      2.30992716  5.956879   -3.34044383]\n",
            " [ 6.00206493  1.70843471 -2.17977009  6.29042378]\n",
            " [-1.6227725  -3.20603849 -0.57106308  0.52138347]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96701297]\n",
            " [-3.48631684]\n",
            " [-6.04426421]\n",
            " [-6.5032379 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.967951  ]\n",
            " [-3.48696352]\n",
            " [-6.04474184]\n",
            " [-6.50364113]]\n",
            "i 1458\n",
            "weight1 before iteration:\n",
            " [[ 5.9365      2.30992716  5.956879   -3.34044383]\n",
            " [ 6.00206493  1.70843471 -2.17977009  6.29042378]\n",
            " [-1.6227725  -3.20603849 -0.57106308  0.52138347]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93666906  2.31020412  5.9572238  -3.34068874]\n",
            " [ 6.00224228  1.70888019 -2.18001142  6.29073052]\n",
            " [-1.62282462 -3.20662909 -0.57099282  0.52147196]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.967951  ]\n",
            " [-3.48696352]\n",
            " [-6.04474184]\n",
            " [-6.50364113]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96888815]\n",
            " [-3.48760971]\n",
            " [-6.04521898]\n",
            " [-6.50404392]]\n",
            "i 1459\n",
            "weight1 before iteration:\n",
            " [[ 5.93666906  2.31020412  5.9572238  -3.34068874]\n",
            " [ 6.00224228  1.70888019 -2.18001142  6.29073052]\n",
            " [-1.62282462 -3.20662909 -0.57099282  0.52147196]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93683795  2.31048086  5.95756823 -3.34093338]\n",
            " [ 6.00241944  1.70932527 -2.18025251  6.29103692]\n",
            " [-1.6228767  -3.20721915 -0.57092261  0.52156037]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96888815]\n",
            " [-3.48760971]\n",
            " [-6.04521898]\n",
            " [-6.50404392]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.96982442]\n",
            " [-3.48825539]\n",
            " [-6.04569563]\n",
            " [-6.50444627]]\n",
            "i 1460\n",
            "weight1 before iteration:\n",
            " [[ 5.93683795  2.31048086  5.95756823 -3.34093338]\n",
            " [ 6.00241944  1.70932527 -2.18025251  6.29103692]\n",
            " [-1.6228767  -3.20721915 -0.57092261  0.52156037]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93700666  2.31075738  5.95791228 -3.34117777]\n",
            " [ 6.00259643  1.70976995 -2.18049335  6.29134298]\n",
            " [-1.62292873 -3.20780867 -0.57085245  0.5216487 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.96982442]\n",
            " [-3.48825539]\n",
            " [-6.04569563]\n",
            " [-6.50444627]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97075981]\n",
            " [-3.48890057]\n",
            " [-6.04617179]\n",
            " [-6.50484819]]\n",
            "i 1461\n",
            "weight1 before iteration:\n",
            " [[ 5.93700666  2.31075738  5.95791228 -3.34117777]\n",
            " [ 6.00259643  1.70976995 -2.18049335  6.29134298]\n",
            " [-1.62292873 -3.20780867 -0.57085245  0.5216487 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9371752   2.31103369  5.95825596 -3.34142191]\n",
            " [ 6.00277323  1.71021423 -2.18073396  6.29164872]\n",
            " [-1.62298072 -3.20839764 -0.57078233  0.52173694]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97075981]\n",
            " [-3.48890057]\n",
            " [-6.04617179]\n",
            " [-6.50484819]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97169433]\n",
            " [-3.48954526]\n",
            " [-6.04664746]\n",
            " [-6.50524967]]\n",
            "i 1462\n",
            "weight1 before iteration:\n",
            " [[ 5.9371752   2.31103369  5.95825596 -3.34142191]\n",
            " [ 6.00277323  1.71021423 -2.18073396  6.29164872]\n",
            " [-1.62298072 -3.20839764 -0.57078233  0.52173694]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93734357  2.31130979  5.95859927 -3.34166579]\n",
            " [ 6.00294985  1.71065812 -2.18097432  6.29195412]\n",
            " [-1.62303267 -3.20898608 -0.57071227  0.5218251 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97169433]\n",
            " [-3.48954526]\n",
            " [-6.04664746]\n",
            " [-6.50524967]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97262796]\n",
            " [-3.49018946]\n",
            " [-6.04712264]\n",
            " [-6.50565073]]\n",
            "i 1463\n",
            "weight1 before iteration:\n",
            " [[ 5.93734357  2.31130979  5.95859927 -3.34166579]\n",
            " [ 6.00294985  1.71065812 -2.18097432  6.29195412]\n",
            " [-1.62303267 -3.20898608 -0.57071227  0.5218251 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93751176  2.31158567  5.95894221 -3.34190943]\n",
            " [ 6.00312629  1.7111016  -2.18121445  6.29225918]\n",
            " [-1.62308457 -3.20957399 -0.57064225  0.52191317]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97262796]\n",
            " [-3.49018946]\n",
            " [-6.04712264]\n",
            " [-6.50565073]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97356072]\n",
            " [-3.49083315]\n",
            " [-6.04759734]\n",
            " [-6.50605135]]\n",
            "i 1464\n",
            "weight1 before iteration:\n",
            " [[ 5.93751176  2.31158567  5.95894221 -3.34190943]\n",
            " [ 6.00312629  1.7111016  -2.18121445  6.29225918]\n",
            " [-1.62308457 -3.20957399 -0.57064225  0.52191317]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93767979  2.31186134  5.95928478 -3.3421528 ]\n",
            " [ 6.00330255  1.71154469 -2.18145434  6.29256392]\n",
            " [-1.62313643 -3.21016136 -0.57057229  0.52200116]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97356072]\n",
            " [-3.49083315]\n",
            " [-6.04759734]\n",
            " [-6.50605135]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9744926 ]\n",
            " [-3.49147636]\n",
            " [-6.04807155]\n",
            " [-6.50645154]]\n",
            "i 1465\n",
            "weight1 before iteration:\n",
            " [[ 5.93767979  2.31186134  5.95928478 -3.3421528 ]\n",
            " [ 6.00330255  1.71154469 -2.18145434  6.29256392]\n",
            " [-1.62313643 -3.21016136 -0.57057229  0.52200116]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93784764  2.31213679  5.95962699 -3.34239593]\n",
            " [ 6.00347862  1.71198739 -2.18169399  6.29286832]\n",
            " [-1.62318824 -3.21074819 -0.57050237  0.52208906]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9744926 ]\n",
            " [-3.49147636]\n",
            " [-6.04807155]\n",
            " [-6.50645154]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97542362]\n",
            " [-3.49211907]\n",
            " [-6.04854528]\n",
            " [-6.5068513 ]]\n",
            "i 1466\n",
            "weight1 before iteration:\n",
            " [[ 5.93784764  2.31213679  5.95962699 -3.34239593]\n",
            " [ 6.00347862  1.71198739 -2.18169399  6.29286832]\n",
            " [-1.62318824 -3.21074819 -0.57050237  0.52208906]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93801531  2.31241204  5.95996882 -3.3426388 ]\n",
            " [ 6.00365452  1.71242969 -2.1819334   6.29317239]\n",
            " [-1.62324001 -3.21133449 -0.5704325   0.52217688]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97542362]\n",
            " [-3.49211907]\n",
            " [-6.04854528]\n",
            " [-6.5068513 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97635376]\n",
            " [-3.49276128]\n",
            " [-6.04901853]\n",
            " [-6.50725063]]\n",
            "i 1467\n",
            "weight1 before iteration:\n",
            " [[ 5.93801531  2.31241204  5.95996882 -3.3426388 ]\n",
            " [ 6.00365452  1.71242969 -2.1819334   6.29317239]\n",
            " [-1.62324001 -3.21133449 -0.5704325   0.52217688]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93818282  2.31268707  5.96031029 -3.34288143]\n",
            " [ 6.00383024  1.71287159 -2.18217258  6.29347613]\n",
            " [-1.62329173 -3.21192025 -0.57036268  0.52226462]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97635376]\n",
            " [-3.49276128]\n",
            " [-6.04901853]\n",
            " [-6.50725063]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97728303]\n",
            " [-3.49340301]\n",
            " [-6.04949129]\n",
            " [-6.50764953]]\n",
            "i 1468\n",
            "weight1 before iteration:\n",
            " [[ 5.93818282  2.31268707  5.96031029 -3.34288143]\n",
            " [ 6.00383024  1.71287159 -2.18217258  6.29347613]\n",
            " [-1.62329173 -3.21192025 -0.57036268  0.52226462]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93835016  2.31296188  5.96065139 -3.3431238 ]\n",
            " [ 6.00400577  1.7133131  -2.18241152  6.29377955]\n",
            " [-1.62334341 -3.21250548 -0.57029291  0.52235227]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97728303]\n",
            " [-3.49340301]\n",
            " [-6.04949129]\n",
            " [-6.50764953]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97821143]\n",
            " [-3.49404424]\n",
            " [-6.04996357]\n",
            " [-6.50804801]]\n",
            "i 1469\n",
            "weight1 before iteration:\n",
            " [[ 5.93835016  2.31296188  5.96065139 -3.3431238 ]\n",
            " [ 6.00400577  1.7133131  -2.18241152  6.29377955]\n",
            " [-1.62334341 -3.21250548 -0.57029291  0.52235227]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93851732  2.31323649  5.96099213 -3.34336592]\n",
            " [ 6.00418113  1.71375421 -2.18265022  6.29408263]\n",
            " [-1.62339505 -3.21309018 -0.57022318  0.52243984]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97821143]\n",
            " [-3.49404424]\n",
            " [-6.04996357]\n",
            " [-6.50804801]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.97913897]\n",
            " [-3.49468499]\n",
            " [-6.05043537]\n",
            " [-6.50844606]]\n",
            "i 1470\n",
            "weight1 before iteration:\n",
            " [[ 5.93851732  2.31323649  5.96099213 -3.34336592]\n",
            " [ 6.00418113  1.71375421 -2.18265022  6.29408263]\n",
            " [-1.62339505 -3.21309018 -0.57022318  0.52243984]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93868432  2.31351088  5.9613325  -3.34360779]\n",
            " [ 6.00435631  1.71419494 -2.18288869  6.29438538]\n",
            " [-1.62344664 -3.21367436 -0.57015351  0.52252732]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.97913897]\n",
            " [-3.49468499]\n",
            " [-6.05043537]\n",
            " [-6.50844606]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98006565]\n",
            " [-3.49532524]\n",
            " [-6.05090669]\n",
            " [-6.50884368]]\n",
            "i 1471\n",
            "weight1 before iteration:\n",
            " [[ 5.93868432  2.31351088  5.9613325  -3.34360779]\n",
            " [ 6.00435631  1.71419494 -2.18288869  6.29438538]\n",
            " [-1.62344664 -3.21367436 -0.57015351  0.52252732]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93885114  2.31378506  5.9616725  -3.34384941]\n",
            " [ 6.00453131  1.71463526 -2.18312692  6.29468781]\n",
            " [-1.62349819 -3.214258   -0.57008388  0.52261473]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98006565]\n",
            " [-3.49532524]\n",
            " [-6.05090669]\n",
            " [-6.50884368]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98099146]\n",
            " [-3.495965  ]\n",
            " [-6.05137753]\n",
            " [-6.50924088]]\n",
            "i 1472\n",
            "weight1 before iteration:\n",
            " [[ 5.93885114  2.31378506  5.9616725  -3.34384941]\n",
            " [ 6.00453131  1.71463526 -2.18312692  6.29468781]\n",
            " [-1.62349819 -3.214258   -0.57008388  0.52261473]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9390178   2.31405903  5.96201214 -3.34409079]\n",
            " [ 6.00470613  1.7150752  -2.18336491  6.29498991]\n",
            " [-1.6235497  -3.21484111 -0.5700143   0.52270205]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98099146]\n",
            " [-3.495965  ]\n",
            " [-6.05137753]\n",
            " [-6.50924088]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9819164 ]\n",
            " [-3.49660428]\n",
            " [-6.05184789]\n",
            " [-6.50963765]]\n",
            "i 1473\n",
            "weight1 before iteration:\n",
            " [[ 5.9390178   2.31405903  5.96201214 -3.34409079]\n",
            " [ 6.00470613  1.7150752  -2.18336491  6.29498991]\n",
            " [-1.6235497  -3.21484111 -0.5700143   0.52270205]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93918428  2.31433279  5.96235142 -3.34433191]\n",
            " [ 6.00488078  1.71551475 -2.18360268  6.29529168]\n",
            " [-1.62360116 -3.21542369 -0.56994477  0.52278929]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9819164 ]\n",
            " [-3.49660428]\n",
            " [-6.05184789]\n",
            " [-6.50963765]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98284049]\n",
            " [-3.49724307]\n",
            " [-6.05231778]\n",
            " [-6.510034  ]]\n",
            "i 1474\n",
            "weight1 before iteration:\n",
            " [[ 5.93918428  2.31433279  5.96235142 -3.34433191]\n",
            " [ 6.00488078  1.71551475 -2.18360268  6.29529168]\n",
            " [-1.62360116 -3.21542369 -0.56994477  0.52278929]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9393506   2.31460634  5.96269034 -3.34457279]\n",
            " [ 6.00505524  1.71595391 -2.1838402   6.29559313]\n",
            " [-1.62365257 -3.21600575 -0.56987529  0.52287644]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98284049]\n",
            " [-3.49724307]\n",
            " [-6.05231778]\n",
            " [-6.510034  ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98376372]\n",
            " [-3.49788137]\n",
            " [-6.05278719]\n",
            " [-6.51042993]]\n",
            "i 1475\n",
            "weight1 before iteration:\n",
            " [[ 5.9393506   2.31460634  5.96269034 -3.34457279]\n",
            " [ 6.00505524  1.71595391 -2.1838402   6.29559313]\n",
            " [-1.62365257 -3.21600575 -0.56987529  0.52287644]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93951674  2.31487968  5.96302889 -3.34481342]\n",
            " [ 6.00522953  1.71639267 -2.1840775   6.29589425]\n",
            " [-1.62370395 -3.21658728 -0.56980585  0.52296351]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98376372]\n",
            " [-3.49788137]\n",
            " [-6.05278719]\n",
            " [-6.51042993]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98468609]\n",
            " [-3.49851918]\n",
            " [-6.05325612]\n",
            " [-6.51082544]]\n",
            "i 1476\n",
            "weight1 before iteration:\n",
            " [[ 5.93951674  2.31487968  5.96302889 -3.34481342]\n",
            " [ 6.00522953  1.71639267 -2.1840775   6.29589425]\n",
            " [-1.62370395 -3.21658728 -0.56980585  0.52296351]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93968272  2.31515281  5.96336709 -3.3450538 ]\n",
            " [ 6.00540364  1.71683105 -2.18431456  6.29619505]\n",
            " [-1.62375528 -3.21716829 -0.56973647  0.5230505 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98468609]\n",
            " [-3.49851918]\n",
            " [-6.05325612]\n",
            " [-6.51082544]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98560761]\n",
            " [-3.49915651]\n",
            " [-6.05372458]\n",
            " [-6.51122052]]\n",
            "i 1477\n",
            "weight1 before iteration:\n",
            " [[ 5.93968272  2.31515281  5.96336709 -3.3450538 ]\n",
            " [ 6.00540364  1.71683105 -2.18431456  6.29619505]\n",
            " [-1.62375528 -3.21716829 -0.56973647  0.5230505 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.93984853  2.31542573  5.96370492 -3.34529394]\n",
            " [ 6.00557758  1.71726904 -2.18455139  6.29649552]\n",
            " [-1.62380657 -3.21774877 -0.56966713  0.52313741]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98560761]\n",
            " [-3.49915651]\n",
            " [-6.05372458]\n",
            " [-6.51122052]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98652827]\n",
            " [-3.49979336]\n",
            " [-6.05419256]\n",
            " [-6.51161519]]\n",
            "i 1478\n",
            "weight1 before iteration:\n",
            " [[ 5.93984853  2.31542573  5.96370492 -3.34529394]\n",
            " [ 6.00557758  1.71726904 -2.18455139  6.29649552]\n",
            " [-1.62380657 -3.21774877 -0.56966713  0.52313741]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94001418  2.31569844  5.96404239 -3.34553383]\n",
            " [ 6.00575134  1.71770664 -2.18478798  6.29679567]\n",
            " [-1.62385781 -3.21832873 -0.56959784  0.52322423]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98652827]\n",
            " [-3.49979336]\n",
            " [-6.05419256]\n",
            " [-6.51161519]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98744808]\n",
            " [-3.50042972]\n",
            " [-6.05466007]\n",
            " [-6.51200943]]\n",
            "i 1479\n",
            "weight1 before iteration:\n",
            " [[ 5.94001418  2.31569844  5.96404239 -3.34553383]\n",
            " [ 6.00575134  1.71770664 -2.18478798  6.29679567]\n",
            " [-1.62385781 -3.21832873 -0.56959784  0.52322423]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94017965  2.31597094  5.96437951 -3.34577347]\n",
            " [ 6.00592492  1.71814385 -2.18502434  6.2970955 ]\n",
            " [-1.62390901 -3.21890816 -0.56952859  0.52331098]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98744808]\n",
            " [-3.50042972]\n",
            " [-6.05466007]\n",
            " [-6.51200943]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98836704]\n",
            " [-3.50106559]\n",
            " [-6.05512711]\n",
            " [-6.51240326]]\n",
            "i 1480\n",
            "weight1 before iteration:\n",
            " [[ 5.94017965  2.31597094  5.96437951 -3.34577347]\n",
            " [ 6.00592492  1.71814385 -2.18502434  6.2970955 ]\n",
            " [-1.62390901 -3.21890816 -0.56952859  0.52331098]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94034496  2.31624323  5.96471627 -3.34601287]\n",
            " [ 6.00609832  1.71858068 -2.18526048  6.297395  ]\n",
            " [-1.62396017 -3.21948708 -0.5694594   0.52339764]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98836704]\n",
            " [-3.50106559]\n",
            " [-6.05512711]\n",
            " [-6.51240326]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.98928515]\n",
            " [-3.50170099]\n",
            " [-6.05559368]\n",
            " [-6.51279667]]\n",
            "i 1481\n",
            "weight1 before iteration:\n",
            " [[ 5.94034496  2.31624323  5.96471627 -3.34601287]\n",
            " [ 6.00609832  1.71858068 -2.18526048  6.297395  ]\n",
            " [-1.62396017 -3.21948708 -0.5694594   0.52339764]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9405101   2.31651531  5.96505266 -3.34625203]\n",
            " [ 6.00627156  1.71901712 -2.18549638  6.29769419]\n",
            " [-1.62401128 -3.22006547 -0.56939025  0.52348422]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.98928515]\n",
            " [-3.50170099]\n",
            " [-6.05559368]\n",
            " [-6.51279667]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99020241]\n",
            " [-3.5023359 ]\n",
            " [-6.05605978]\n",
            " [-6.51318966]]\n",
            "i 1482\n",
            "weight1 before iteration:\n",
            " [[ 5.9405101   2.31651531  5.96505266 -3.34625203]\n",
            " [ 6.00627156  1.71901712 -2.18549638  6.29769419]\n",
            " [-1.62401128 -3.22006547 -0.56939025  0.52348422]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94067507  2.31678719  5.96538871 -3.34649094]\n",
            " [ 6.00644461  1.71945317 -2.18573205  6.29799305]\n",
            " [-1.62406236 -3.22064334 -0.56932115  0.52357072]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99020241]\n",
            " [-3.5023359 ]\n",
            " [-6.05605978]\n",
            " [-6.51318966]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99111882]\n",
            " [-3.50297033]\n",
            " [-6.05652541]\n",
            " [-6.51358223]]\n",
            "i 1483\n",
            "weight1 before iteration:\n",
            " [[ 5.94067507  2.31678719  5.96538871 -3.34649094]\n",
            " [ 6.00644461  1.71945317 -2.18573205  6.29799305]\n",
            " [-1.62406236 -3.22064334 -0.56932115  0.52357072]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94083988  2.31705886  5.96572439 -3.34672961]\n",
            " [ 6.00661749  1.71988884 -2.18596748  6.29829159]\n",
            " [-1.62411338 -3.2212207  -0.56925209  0.52365713]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99111882]\n",
            " [-3.50297033]\n",
            " [-6.05652541]\n",
            " [-6.51358223]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99203439]\n",
            " [-3.50360428]\n",
            " [-6.05699056]\n",
            " [-6.51397439]]\n",
            "i 1484\n",
            "weight1 before iteration:\n",
            " [[ 5.94083988  2.31705886  5.96572439 -3.34672961]\n",
            " [ 6.00661749  1.71988884 -2.18596748  6.29829159]\n",
            " [-1.62411338 -3.2212207  -0.56925209  0.52365713]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94100452  2.31733032  5.96605972 -3.34696803]\n",
            " [ 6.0067902   1.72032413 -2.18620269  6.29858981]\n",
            " [-1.62416437 -3.22179754 -0.56918309  0.52374347]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99203439]\n",
            " [-3.50360428]\n",
            " [-6.05699056]\n",
            " [-6.51397439]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99294911]\n",
            " [-3.50423775]\n",
            " [-6.05745526]\n",
            " [-6.51436614]]\n",
            "i 1485\n",
            "weight1 before iteration:\n",
            " [[ 5.94100452  2.31733032  5.96605972 -3.34696803]\n",
            " [ 6.0067902   1.72032413 -2.18620269  6.29858981]\n",
            " [-1.62416437 -3.22179754 -0.56918309  0.52374347]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.941169    2.31760157  5.9663947  -3.34720621]\n",
            " [ 6.00696273  1.72075903 -2.18643767  6.29888772]\n",
            " [-1.62421531 -3.22237385 -0.56911413  0.52382972]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99294911]\n",
            " [-3.50423775]\n",
            " [-6.05745526]\n",
            " [-6.51436614]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99386299]\n",
            " [-3.50487074]\n",
            " [-6.05791948]\n",
            " [-6.51475747]]\n",
            "i 1486\n",
            "weight1 before iteration:\n",
            " [[ 5.941169    2.31760157  5.9663947  -3.34720621]\n",
            " [ 6.00696273  1.72075903 -2.18643767  6.29888772]\n",
            " [-1.62421531 -3.22237385 -0.56911413  0.52382972]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94133331  2.31787262  5.96672932 -3.34744415]\n",
            " [ 6.00713509  1.72119355 -2.18667242  6.2991853 ]\n",
            " [-1.62426621 -3.22294966 -0.56904521  0.5239159 ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99386299]\n",
            " [-3.50487074]\n",
            " [-6.05791948]\n",
            " [-6.51475747]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99477603]\n",
            " [-3.50550326]\n",
            " [-6.05838324]\n",
            " [-6.51514839]]\n",
            "i 1487\n",
            "weight1 before iteration:\n",
            " [[ 5.94133331  2.31787262  5.96672932 -3.34744415]\n",
            " [ 6.00713509  1.72119355 -2.18667242  6.2991853 ]\n",
            " [-1.62426621 -3.22294966 -0.56904521  0.5239159 ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94149745  2.31814346  5.96706359 -3.34768184]\n",
            " [ 6.00730728  1.72162769 -2.18690694  6.29948257]\n",
            " [-1.62431707 -3.22352495 -0.56897635  0.52400199]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99477603]\n",
            " [-3.50550326]\n",
            " [-6.05838324]\n",
            " [-6.51514839]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99568823]\n",
            " [-3.50613529]\n",
            " [-6.05884653]\n",
            " [-6.5155389 ]]\n",
            "i 1488\n",
            "weight1 before iteration:\n",
            " [[ 5.94149745  2.31814346  5.96706359 -3.34768184]\n",
            " [ 6.00730728  1.72162769 -2.18690694  6.29948257]\n",
            " [-1.62431707 -3.22352495 -0.56897635  0.52400199]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94166143  2.31841409  5.9673975  -3.3479193 ]\n",
            " [ 6.00747929  1.72206145 -2.18714124  6.29977952]\n",
            " [-1.62436788 -3.22409972 -0.56890753  0.524088  ]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99568823]\n",
            " [-3.50613529]\n",
            " [-6.05884653]\n",
            " [-6.5155389 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99659959]\n",
            " [-3.50676685]\n",
            " [-6.05930936]\n",
            " [-6.51592899]]\n",
            "i 1489\n",
            "weight1 before iteration:\n",
            " [[ 5.94166143  2.31841409  5.9673975  -3.3479193 ]\n",
            " [ 6.00747929  1.72206145 -2.18714124  6.29977952]\n",
            " [-1.62436788 -3.22409972 -0.56890753  0.524088  ]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94182525  2.31868452  5.96773106 -3.34815651]\n",
            " [ 6.00765113  1.72249482 -2.1873753   6.30007615]\n",
            " [-1.62441866 -3.22467398 -0.56883876  0.52417394]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99659959]\n",
            " [-3.50676685]\n",
            " [-6.05930936]\n",
            " [-6.51592899]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99751012]\n",
            " [-3.50739793]\n",
            " [-6.05977172]\n",
            " [-6.51631868]]\n",
            "i 1490\n",
            "weight1 before iteration:\n",
            " [[ 5.94182525  2.31868452  5.96773106 -3.34815651]\n",
            " [ 6.00765113  1.72249482 -2.1873753   6.30007615]\n",
            " [-1.62441866 -3.22467398 -0.56883876  0.52417394]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.9419889   2.31895475  5.96806427 -3.34839348]\n",
            " [ 6.0078228   1.72292781 -2.18760914  6.30037247]\n",
            " [-1.62446939 -3.22524772 -0.56877004  0.52425979]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99751012]\n",
            " [-3.50739793]\n",
            " [-6.05977172]\n",
            " [-6.51631868]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.9984198 ]\n",
            " [-3.50802854]\n",
            " [-6.06023362]\n",
            " [-6.51670795]]\n",
            "i 1491\n",
            "weight1 before iteration:\n",
            " [[ 5.9419889   2.31895475  5.96806427 -3.34839348]\n",
            " [ 6.0078228   1.72292781 -2.18760914  6.30037247]\n",
            " [-1.62446939 -3.22524772 -0.56877004  0.52425979]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94215239  2.31922476  5.96839713 -3.34863021]\n",
            " [ 6.00799429  1.72336043 -2.18784275  6.30066847]\n",
            " [-1.62452007 -3.22582096 -0.56870136  0.52434556]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.9984198 ]\n",
            " [-3.50802854]\n",
            " [-6.06023362]\n",
            " [-6.51670795]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[10.99932866]\n",
            " [-3.50865867]\n",
            " [-6.06069506]\n",
            " [-6.51709682]]\n",
            "i 1492\n",
            "weight1 before iteration:\n",
            " [[ 5.94215239  2.31922476  5.96839713 -3.34863021]\n",
            " [ 6.00799429  1.72336043 -2.18784275  6.30066847]\n",
            " [-1.62452007 -3.22582096 -0.56870136  0.52434556]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94231571  2.31949458  5.96872964 -3.3488667 ]\n",
            " [ 6.00816562  1.72379266 -2.18807613  6.30096416]\n",
            " [-1.62457072 -3.22639368 -0.56863273  0.52443125]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[10.99932866]\n",
            " [-3.50865867]\n",
            " [-6.06069506]\n",
            " [-6.51709682]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00023668]\n",
            " [-3.50928833]\n",
            " [-6.06115604]\n",
            " [-6.51748527]]\n",
            "i 1493\n",
            "weight1 before iteration:\n",
            " [[ 5.94231571  2.31949458  5.96872964 -3.3488667 ]\n",
            " [ 6.00816562  1.72379266 -2.18807613  6.30096416]\n",
            " [-1.62457072 -3.22639368 -0.56863273  0.52443125]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94247887  2.31976418  5.9690618  -3.34910296]\n",
            " [ 6.00833677  1.72422452 -2.18830929  6.30125953]\n",
            " [-1.62462132 -3.2269659  -0.56856415  0.52451686]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00023668]\n",
            " [-3.50928833]\n",
            " [-6.06115604]\n",
            " [-6.51748527]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00114388]\n",
            " [-3.50991751]\n",
            " [-6.06161656]\n",
            " [-6.51787332]]\n",
            "i 1494\n",
            "weight1 before iteration:\n",
            " [[ 5.94247887  2.31976418  5.9690618  -3.34910296]\n",
            " [ 6.00833677  1.72422452 -2.18830929  6.30125953]\n",
            " [-1.62462132 -3.2269659  -0.56856415  0.52451686]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94264187  2.32003359  5.96939361 -3.34933897]\n",
            " [ 6.00850775  1.724656   -2.18854222  6.30155459]\n",
            " [-1.62467188 -3.2275376  -0.56849561  0.52460239]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00114388]\n",
            " [-3.50991751]\n",
            " [-6.06161656]\n",
            " [-6.51787332]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00205024]\n",
            " [-3.51054622]\n",
            " [-6.06207662]\n",
            " [-6.51826096]]\n",
            "i 1495\n",
            "weight1 before iteration:\n",
            " [[ 5.94264187  2.32003359  5.96939361 -3.34933897]\n",
            " [ 6.00850775  1.724656   -2.18854222  6.30155459]\n",
            " [-1.62467188 -3.2275376  -0.56849561  0.52460239]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94280471  2.32030279  5.96972508 -3.34957475]\n",
            " [ 6.00867856  1.7250871  -2.18877493  6.30184933]\n",
            " [-1.6247224  -3.22810879 -0.56842712  0.52468784]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00205024]\n",
            " [-3.51054622]\n",
            " [-6.06207662]\n",
            " [-6.51826096]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00295577]\n",
            " [-3.51117446]\n",
            " [-6.06253622]\n",
            " [-6.5186482 ]]\n",
            "i 1496\n",
            "weight1 before iteration:\n",
            " [[ 5.94280471  2.32030279  5.96972508 -3.34957475]\n",
            " [ 6.00867856  1.7250871  -2.18877493  6.30184933]\n",
            " [-1.6247224  -3.22810879 -0.56842712  0.52468784]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94296738  2.32057178  5.97005619 -3.34981028]\n",
            " [ 6.00884919  1.72551782 -2.18900741  6.30214377]\n",
            " [-1.62477288 -3.22867948 -0.56835868  0.52477321]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00295577]\n",
            " [-3.51117446]\n",
            " [-6.06253622]\n",
            " [-6.5186482 ]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00386048]\n",
            " [-3.51180223]\n",
            " [-6.06299536]\n",
            " [-6.51903503]]\n",
            "i 1497\n",
            "weight1 before iteration:\n",
            " [[ 5.94296738  2.32057178  5.97005619 -3.34981028]\n",
            " [ 6.00884919  1.72551782 -2.18900741  6.30214377]\n",
            " [-1.62477288 -3.22867948 -0.56835868  0.52477321]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94312989  2.32084057  5.97038696 -3.35004558]\n",
            " [ 6.00901966  1.72594817 -2.18923967  6.30243789]\n",
            " [-1.62482331 -3.22924966 -0.56829029  0.52485851]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00386048]\n",
            " [-3.51180223]\n",
            " [-6.06299536]\n",
            " [-6.51903503]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00476436]\n",
            " [-3.51242952]\n",
            " [-6.06345404]\n",
            " [-6.51942146]]\n",
            "i 1498\n",
            "weight1 before iteration:\n",
            " [[ 5.94312989  2.32084057  5.97038696 -3.35004558]\n",
            " [ 6.00901966  1.72594817 -2.18923967  6.30243789]\n",
            " [-1.62482331 -3.22924966 -0.56829029  0.52485851]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94329224  2.32110916  5.97071738 -3.35028065]\n",
            " [ 6.00918996  1.72637814 -2.1894717   6.3027317 ]\n",
            " [-1.6248737  -3.22981934 -0.56822194  0.52494372]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00476436]\n",
            " [-3.51242952]\n",
            " [-6.06345404]\n",
            " [-6.51942146]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00566742]\n",
            " [-3.51305635]\n",
            " [-6.06391227]\n",
            " [-6.51980748]]\n",
            "i 1499\n",
            "weight1 before iteration:\n",
            " [[ 5.94329224  2.32110916  5.97071738 -3.35028065]\n",
            " [ 6.00918996  1.72637814 -2.1894717   6.3027317 ]\n",
            " [-1.6248737  -3.22981934 -0.56822194  0.52494372]]\n",
            "\n",
            "weight1 after iteration:\n",
            " [[ 5.94345442  2.32137755  5.97104746 -3.35051547]\n",
            " [ 6.00936009  1.72680774 -2.18970351  6.3030252 ]\n",
            " [-1.62492406 -3.23038851 -0.56815363  0.52502885]]\n",
            "\n",
            "weight2 before iteration:\n",
            " [[11.00566742]\n",
            " [-3.51305635]\n",
            " [-6.06391227]\n",
            " [-6.51980748]]\n",
            "\n",
            "weight2 after iteration:\n",
            " [[11.00656966]\n",
            " [-3.51368271]\n",
            " [-6.06437004]\n",
            " [-6.5201931 ]]\n",
            "\n",
            "output [[0.01071308]\n",
            " [0.97218915]\n",
            " [0.97372609]\n",
            " [0.03108494]]\n",
            "\n",
            " cost:  0.024573472940337106\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "psdug1DPkLMT",
        "colab_type": "text"
      },
      "source": [
        "**Running code with zero weight initializations:**\n",
        "##### Added bias in both layers\n",
        "##### weight change will be small and weight will become nagative\n",
        "##### output is [0.5, 0.5, 0.5, 0.5] even after 70000 epochs"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TPEFEN7VlPZb",
        "colab_type": "text"
      },
      "source": [
        "**Running code with Random Weights**\n",
        "##### with random weights and same bias\n",
        "##### output in 1000 epoch is [0,0.9,0.9,0]"
      ]
    }
  ]
}