Credit Card Fraud Detection.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Credit Card Fraud Detection\n",
    "\n",
    "In this notebook I'll try to implement a classifier using the KNN algorithm to determine if a transaction is fraudulent or not.\n",
    "\n",
    "Using data from [Credit Card Fraud Detection](https://www.kaggle.com/mlg-ulb/creditcardfraud)\n",
    "\n",
    "The sections of this analysis include:\n",
    "- Exploring the data\n",
    "- Building a classifier with KNN(scikit-learn)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Import modules"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import glob\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as pln\n",
    "%matplotlib inline\n",
    "import seaborn as sns\n",
    "sns.set(style=\"darkgrid\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Import data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['creditcard.csv']\n"
     ]
    }
   ],
   "source": [
    "# List all csv files from root directory\n",
    "print(glob.glob('*.csv'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import data\n",
    "cred_data = pd.read_csv('creditcard.csv',sep=',') "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Exploring data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(284807, 31)"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Rows and Columns\n",
    "cred_data.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Time', 'V1', 'V2', 'V3', 'V4', 'V5', 'V6', 'V7', 'V8', 'V9', 'V10',\n",
       "       'V11', 'V12', 'V13', 'V14', 'V15', 'V16', 'V17', 'V18', 'V19', 'V20',\n",
       "       'V21', 'V22', 'V23', 'V24', 'V25', 'V26', 'V27', 'V28', 'Amount',\n",
       "       'Class'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# List keys\n",
    "cred_data.keys()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Time</th>\n",
       "      <th>V1</th>\n",
       "      <th>V2</th>\n",
       "      <th>V3</th>\n",
       "      <th>V4</th>\n",
       "      <th>V5</th>\n",
       "      <th>V6</th>\n",
       "      <th>V7</th>\n",
       "      <th>V8</th>\n",
       "      <th>V9</th>\n",
       "      <th>...</th>\n",
       "      <th>V21</th>\n",
       "      <th>V22</th>\n",
       "      <th>V23</th>\n",
       "      <th>V24</th>\n",
       "      <th>V25</th>\n",
       "      <th>V26</th>\n",
       "      <th>V27</th>\n",
       "      <th>V28</th>\n",
       "      <th>Amount</th>\n",
       "      <th>Class</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.359807</td>\n",
       "      <td>-0.072781</td>\n",
       "      <td>2.536347</td>\n",
       "      <td>1.378155</td>\n",
       "      <td>-0.338321</td>\n",
       "      <td>0.462388</td>\n",
       "      <td>0.239599</td>\n",
       "      <td>0.098698</td>\n",
       "      <td>0.363787</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.018307</td>\n",
       "      <td>0.277838</td>\n",
       "      <td>-0.110474</td>\n",
       "      <td>0.066928</td>\n",
       "      <td>0.128539</td>\n",
       "      <td>-0.189115</td>\n",
       "      <td>0.133558</td>\n",
       "      <td>-0.021053</td>\n",
       "      <td>149.62</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.0</td>\n",
       "      <td>1.191857</td>\n",
       "      <td>0.266151</td>\n",
       "      <td>0.166480</td>\n",
       "      <td>0.448154</td>\n",
       "      <td>0.060018</td>\n",
       "      <td>-0.082361</td>\n",
       "      <td>-0.078803</td>\n",
       "      <td>0.085102</td>\n",
       "      <td>-0.255425</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.225775</td>\n",
       "      <td>-0.638672</td>\n",
       "      <td>0.101288</td>\n",
       "      <td>-0.339846</td>\n",
       "      <td>0.167170</td>\n",
       "      <td>0.125895</td>\n",
       "      <td>-0.008983</td>\n",
       "      <td>0.014724</td>\n",
       "      <td>2.69</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-1.358354</td>\n",
       "      <td>-1.340163</td>\n",
       "      <td>1.773209</td>\n",
       "      <td>0.379780</td>\n",
       "      <td>-0.503198</td>\n",
       "      <td>1.800499</td>\n",
       "      <td>0.791461</td>\n",
       "      <td>0.247676</td>\n",
       "      <td>-1.514654</td>\n",
       "      <td>...</td>\n",
       "      <td>0.247998</td>\n",
       "      <td>0.771679</td>\n",
       "      <td>0.909412</td>\n",
       "      <td>-0.689281</td>\n",
       "      <td>-0.327642</td>\n",
       "      <td>-0.139097</td>\n",
       "      <td>-0.055353</td>\n",
       "      <td>-0.059752</td>\n",
       "      <td>378.66</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.966272</td>\n",
       "      <td>-0.185226</td>\n",
       "      <td>1.792993</td>\n",
       "      <td>-0.863291</td>\n",
       "      <td>-0.010309</td>\n",
       "      <td>1.247203</td>\n",
       "      <td>0.237609</td>\n",
       "      <td>0.377436</td>\n",
       "      <td>-1.387024</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.108300</td>\n",
       "      <td>0.005274</td>\n",
       "      <td>-0.190321</td>\n",
       "      <td>-1.175575</td>\n",
       "      <td>0.647376</td>\n",
       "      <td>-0.221929</td>\n",
       "      <td>0.062723</td>\n",
       "      <td>0.061458</td>\n",
       "      <td>123.50</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.158233</td>\n",
       "      <td>0.877737</td>\n",
       "      <td>1.548718</td>\n",
       "      <td>0.403034</td>\n",
       "      <td>-0.407193</td>\n",
       "      <td>0.095921</td>\n",
       "      <td>0.592941</td>\n",
       "      <td>-0.270533</td>\n",
       "      <td>0.817739</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.009431</td>\n",
       "      <td>0.798278</td>\n",
       "      <td>-0.137458</td>\n",
       "      <td>0.141267</td>\n",
       "      <td>-0.206010</td>\n",
       "      <td>0.502292</td>\n",
       "      <td>0.219422</td>\n",
       "      <td>0.215153</td>\n",
       "      <td>69.99</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   Time        V1        V2        V3        V4        V5        V6        V7  \\\n",
       "0   0.0 -1.359807 -0.072781  2.536347  1.378155 -0.338321  0.462388  0.239599   \n",
       "1   0.0  1.191857  0.266151  0.166480  0.448154  0.060018 -0.082361 -0.078803   \n",
       "2   1.0 -1.358354 -1.340163  1.773209  0.379780 -0.503198  1.800499  0.791461   \n",
       "3   1.0 -0.966272 -0.185226  1.792993 -0.863291 -0.010309  1.247203  0.237609   \n",
       "4   2.0 -1.158233  0.877737  1.548718  0.403034 -0.407193  0.095921  0.592941   \n",
       "\n",
       "         V8        V9  ...         V21       V22       V23       V24  \\\n",
       "0  0.098698  0.363787  ...   -0.018307  0.277838 -0.110474  0.066928   \n",
       "1  0.085102 -0.255425  ...   -0.225775 -0.638672  0.101288 -0.339846   \n",
       "2  0.247676 -1.514654  ...    0.247998  0.771679  0.909412 -0.689281   \n",
       "3  0.377436 -1.387024  ...   -0.108300  0.005274 -0.190321 -1.175575   \n",
       "4 -0.270533  0.817739  ...   -0.009431  0.798278 -0.137458  0.141267   \n",
       "\n",
       "        V25       V26       V27       V28  Amount  Class  \n",
       "0  0.128539 -0.189115  0.133558 -0.021053  149.62      0  \n",
       "1  0.167170  0.125895 -0.008983  0.014724    2.69      0  \n",
       "2 -0.327642 -0.139097 -0.055353 -0.059752  378.66      0  \n",
       "3  0.647376 -0.221929  0.062723  0.061458  123.50      0  \n",
       "4 -0.206010  0.502292  0.219422  0.215153   69.99      0  \n",
       "\n",
       "[5 rows x 31 columns]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# First 5 rows\n",
    "cred_data.head(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 284807 entries, 0 to 284806\n",
      "Data columns (total 31 columns):\n",
      "Time      284807 non-null float64\n",
      "V1        284807 non-null float64\n",
      "V2        284807 non-null float64\n",
      "V3        284807 non-null float64\n",
      "V4        284807 non-null float64\n",
      "V5        284807 non-null float64\n",
      "V6        284807 non-null float64\n",
      "V7        284807 non-null float64\n",
      "V8        284807 non-null float64\n",
      "V9        284807 non-null float64\n",
      "V10       284807 non-null float64\n",
      "V11       284807 non-null float64\n",
      "V12       284807 non-null float64\n",
      "V13       284807 non-null float64\n",
      "V14       284807 non-null float64\n",
      "V15       284807 non-null float64\n",
      "V16       284807 non-null float64\n",
      "V17       284807 non-null float64\n",
      "V18       284807 non-null float64\n",
      "V19       284807 non-null float64\n",
      "V20       284807 non-null float64\n",
      "V21       284807 non-null float64\n",
      "V22       284807 non-null float64\n",
      "V23       284807 non-null float64\n",
      "V24       284807 non-null float64\n",
      "V25       284807 non-null float64\n",
      "V26       284807 non-null float64\n",
      "V27       284807 non-null float64\n",
      "V28       284807 non-null float64\n",
      "Amount    284807 non-null float64\n",
      "Class     284807 non-null int64\n",
      "dtypes: float64(30), int64(1)\n",
      "memory usage: 67.4 MB\n"
     ]
    }
   ],
   "source": [
    "# Some infos about data\n",
    "cred_data.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check null values\n",
    "cred_data.isnull().values.any()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Rename 'Class' to 'Fraud'.\n",
    "cred_data = cred_data.rename(columns={'Class': 'Fraud'})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Time</th>\n",
       "      <th>V1</th>\n",
       "      <th>V2</th>\n",
       "      <th>V3</th>\n",
       "      <th>V4</th>\n",
       "      <th>V5</th>\n",
       "      <th>V6</th>\n",
       "      <th>V7</th>\n",
       "      <th>V8</th>\n",
       "      <th>V9</th>\n",
       "      <th>...</th>\n",
       "      <th>V21</th>\n",
       "      <th>V22</th>\n",
       "      <th>V23</th>\n",
       "      <th>V24</th>\n",
       "      <th>V25</th>\n",
       "      <th>V26</th>\n",
       "      <th>V27</th>\n",
       "      <th>V28</th>\n",
       "      <th>Amount</th>\n",
       "      <th>Fraud</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.359807</td>\n",
       "      <td>-0.072781</td>\n",
       "      <td>2.536347</td>\n",
       "      <td>1.378155</td>\n",
       "      <td>-0.338321</td>\n",
       "      <td>0.462388</td>\n",
       "      <td>0.239599</td>\n",
       "      <td>0.098698</td>\n",
       "      <td>0.363787</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.018307</td>\n",
       "      <td>0.277838</td>\n",
       "      <td>-0.110474</td>\n",
       "      <td>0.066928</td>\n",
       "      <td>0.128539</td>\n",
       "      <td>-0.189115</td>\n",
       "      <td>0.133558</td>\n",
       "      <td>-0.021053</td>\n",
       "      <td>149.62</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.0</td>\n",
       "      <td>1.191857</td>\n",
       "      <td>0.266151</td>\n",
       "      <td>0.166480</td>\n",
       "      <td>0.448154</td>\n",
       "      <td>0.060018</td>\n",
       "      <td>-0.082361</td>\n",
       "      <td>-0.078803</td>\n",
       "      <td>0.085102</td>\n",
       "      <td>-0.255425</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.225775</td>\n",
       "      <td>-0.638672</td>\n",
       "      <td>0.101288</td>\n",
       "      <td>-0.339846</td>\n",
       "      <td>0.167170</td>\n",
       "      <td>0.125895</td>\n",
       "      <td>-0.008983</td>\n",
       "      <td>0.014724</td>\n",
       "      <td>2.69</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-1.358354</td>\n",
       "      <td>-1.340163</td>\n",
       "      <td>1.773209</td>\n",
       "      <td>0.379780</td>\n",
       "      <td>-0.503198</td>\n",
       "      <td>1.800499</td>\n",
       "      <td>0.791461</td>\n",
       "      <td>0.247676</td>\n",
       "      <td>-1.514654</td>\n",
       "      <td>...</td>\n",
       "      <td>0.247998</td>\n",
       "      <td>0.771679</td>\n",
       "      <td>0.909412</td>\n",
       "      <td>-0.689281</td>\n",
       "      <td>-0.327642</td>\n",
       "      <td>-0.139097</td>\n",
       "      <td>-0.055353</td>\n",
       "      <td>-0.059752</td>\n",
       "      <td>378.66</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.966272</td>\n",
       "      <td>-0.185226</td>\n",
       "      <td>1.792993</td>\n",
       "      <td>-0.863291</td>\n",
       "      <td>-0.010309</td>\n",
       "      <td>1.247203</td>\n",
       "      <td>0.237609</td>\n",
       "      <td>0.377436</td>\n",
       "      <td>-1.387024</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.108300</td>\n",
       "      <td>0.005274</td>\n",
       "      <td>-0.190321</td>\n",
       "      <td>-1.175575</td>\n",
       "      <td>0.647376</td>\n",
       "      <td>-0.221929</td>\n",
       "      <td>0.062723</td>\n",
       "      <td>0.061458</td>\n",
       "      <td>123.50</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.158233</td>\n",
       "      <td>0.877737</td>\n",
       "      <td>1.548718</td>\n",
       "      <td>0.403034</td>\n",
       "      <td>-0.407193</td>\n",
       "      <td>0.095921</td>\n",
       "      <td>0.592941</td>\n",
       "      <td>-0.270533</td>\n",
       "      <td>0.817739</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.009431</td>\n",
       "      <td>0.798278</td>\n",
       "      <td>-0.137458</td>\n",
       "      <td>0.141267</td>\n",
       "      <td>-0.206010</td>\n",
       "      <td>0.502292</td>\n",
       "      <td>0.219422</td>\n",
       "      <td>0.215153</td>\n",
       "      <td>69.99</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   Time        V1        V2        V3        V4        V5        V6        V7  \\\n",
       "0   0.0 -1.359807 -0.072781  2.536347  1.378155 -0.338321  0.462388  0.239599   \n",
       "1   0.0  1.191857  0.266151  0.166480  0.448154  0.060018 -0.082361 -0.078803   \n",
       "2   1.0 -1.358354 -1.340163  1.773209  0.379780 -0.503198  1.800499  0.791461   \n",
       "3   1.0 -0.966272 -0.185226  1.792993 -0.863291 -0.010309  1.247203  0.237609   \n",
       "4   2.0 -1.158233  0.877737  1.548718  0.403034 -0.407193  0.095921  0.592941   \n",
       "\n",
       "         V8        V9  ...         V21       V22       V23       V24  \\\n",
       "0  0.098698  0.363787  ...   -0.018307  0.277838 -0.110474  0.066928   \n",
       "1  0.085102 -0.255425  ...   -0.225775 -0.638672  0.101288 -0.339846   \n",
       "2  0.247676 -1.514654  ...    0.247998  0.771679  0.909412 -0.689281   \n",
       "3  0.377436 -1.387024  ...   -0.108300  0.005274 -0.190321 -1.175575   \n",
       "4 -0.270533  0.817739  ...   -0.009431  0.798278 -0.137458  0.141267   \n",
       "\n",
       "        V25       V26       V27       V28  Amount  Fraud  \n",
       "0  0.128539 -0.189115  0.133558 -0.021053  149.62      0  \n",
       "1  0.167170  0.125895 -0.008983  0.014724    2.69      0  \n",
       "2 -0.327642 -0.139097 -0.055353 -0.059752  378.66      0  \n",
       "3  0.647376 -0.221929  0.062723  0.061458  123.50      0  \n",
       "4 -0.206010  0.502292  0.219422  0.215153   69.99      0  \n",
       "\n",
       "[5 rows x 31 columns]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# First 5 rows\n",
    "cred_data.head(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/anaconda3/lib/python3.6/site-packages/ipykernel_launcher.py:5: FutureWarning: reshape is deprecated and will raise in a subsequent release. Please use .values.reshape(...) instead\n",
      "  \"\"\"\n"
     ]
    }
   ],
   "source": [
    "# Import standscaler from preprocessing package to normalize data\n",
    "from sklearn.preprocessing import StandardScaler\n",
    "\n",
    "# Normalizing amount column\n",
    "cred_data['Amount'] = StandardScaler().fit_transform(cred_data['Amount'].reshape(-1, 1))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Time</th>\n",
       "      <th>V1</th>\n",
       "      <th>V2</th>\n",
       "      <th>V3</th>\n",
       "      <th>V4</th>\n",
       "      <th>V5</th>\n",
       "      <th>V6</th>\n",
       "      <th>V7</th>\n",
       "      <th>V8</th>\n",
       "      <th>V9</th>\n",
       "      <th>...</th>\n",
       "      <th>V21</th>\n",
       "      <th>V22</th>\n",
       "      <th>V23</th>\n",
       "      <th>V24</th>\n",
       "      <th>V25</th>\n",
       "      <th>V26</th>\n",
       "      <th>V27</th>\n",
       "      <th>V28</th>\n",
       "      <th>Amount</th>\n",
       "      <th>Fraud</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.0</td>\n",
       "      <td>-1.359807</td>\n",
       "      <td>-0.072781</td>\n",
       "      <td>2.536347</td>\n",
       "      <td>1.378155</td>\n",
       "      <td>-0.338321</td>\n",
       "      <td>0.462388</td>\n",
       "      <td>0.239599</td>\n",
       "      <td>0.098698</td>\n",
       "      <td>0.363787</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.018307</td>\n",
       "      <td>0.277838</td>\n",
       "      <td>-0.110474</td>\n",
       "      <td>0.066928</td>\n",
       "      <td>0.128539</td>\n",
       "      <td>-0.189115</td>\n",
       "      <td>0.133558</td>\n",
       "      <td>-0.021053</td>\n",
       "      <td>0.244964</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.0</td>\n",
       "      <td>1.191857</td>\n",
       "      <td>0.266151</td>\n",
       "      <td>0.166480</td>\n",
       "      <td>0.448154</td>\n",
       "      <td>0.060018</td>\n",
       "      <td>-0.082361</td>\n",
       "      <td>-0.078803</td>\n",
       "      <td>0.085102</td>\n",
       "      <td>-0.255425</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.225775</td>\n",
       "      <td>-0.638672</td>\n",
       "      <td>0.101288</td>\n",
       "      <td>-0.339846</td>\n",
       "      <td>0.167170</td>\n",
       "      <td>0.125895</td>\n",
       "      <td>-0.008983</td>\n",
       "      <td>0.014724</td>\n",
       "      <td>-0.342475</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-1.358354</td>\n",
       "      <td>-1.340163</td>\n",
       "      <td>1.773209</td>\n",
       "      <td>0.379780</td>\n",
       "      <td>-0.503198</td>\n",
       "      <td>1.800499</td>\n",
       "      <td>0.791461</td>\n",
       "      <td>0.247676</td>\n",
       "      <td>-1.514654</td>\n",
       "      <td>...</td>\n",
       "      <td>0.247998</td>\n",
       "      <td>0.771679</td>\n",
       "      <td>0.909412</td>\n",
       "      <td>-0.689281</td>\n",
       "      <td>-0.327642</td>\n",
       "      <td>-0.139097</td>\n",
       "      <td>-0.055353</td>\n",
       "      <td>-0.059752</td>\n",
       "      <td>1.160686</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1.0</td>\n",
       "      <td>-0.966272</td>\n",
       "      <td>-0.185226</td>\n",
       "      <td>1.792993</td>\n",
       "      <td>-0.863291</td>\n",
       "      <td>-0.010309</td>\n",
       "      <td>1.247203</td>\n",
       "      <td>0.237609</td>\n",
       "      <td>0.377436</td>\n",
       "      <td>-1.387024</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.108300</td>\n",
       "      <td>0.005274</td>\n",
       "      <td>-0.190321</td>\n",
       "      <td>-1.175575</td>\n",
       "      <td>0.647376</td>\n",
       "      <td>-0.221929</td>\n",
       "      <td>0.062723</td>\n",
       "      <td>0.061458</td>\n",
       "      <td>0.140534</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.158233</td>\n",
       "      <td>0.877737</td>\n",
       "      <td>1.548718</td>\n",
       "      <td>0.403034</td>\n",
       "      <td>-0.407193</td>\n",
       "      <td>0.095921</td>\n",
       "      <td>0.592941</td>\n",
       "      <td>-0.270533</td>\n",
       "      <td>0.817739</td>\n",
       "      <td>...</td>\n",
       "      <td>-0.009431</td>\n",
       "      <td>0.798278</td>\n",
       "      <td>-0.137458</td>\n",
       "      <td>0.141267</td>\n",
       "      <td>-0.206010</td>\n",
       "      <td>0.502292</td>\n",
       "      <td>0.219422</td>\n",
       "      <td>0.215153</td>\n",
       "      <td>-0.073403</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 31 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "   Time        V1        V2        V3        V4        V5        V6        V7  \\\n",
       "0   0.0 -1.359807 -0.072781  2.536347  1.378155 -0.338321  0.462388  0.239599   \n",
       "1   0.0  1.191857  0.266151  0.166480  0.448154  0.060018 -0.082361 -0.078803   \n",
       "2   1.0 -1.358354 -1.340163  1.773209  0.379780 -0.503198  1.800499  0.791461   \n",
       "3   1.0 -0.966272 -0.185226  1.792993 -0.863291 -0.010309  1.247203  0.237609   \n",
       "4   2.0 -1.158233  0.877737  1.548718  0.403034 -0.407193  0.095921  0.592941   \n",
       "\n",
       "         V8        V9  ...         V21       V22       V23       V24  \\\n",
       "0  0.098698  0.363787  ...   -0.018307  0.277838 -0.110474  0.066928   \n",
       "1  0.085102 -0.255425  ...   -0.225775 -0.638672  0.101288 -0.339846   \n",
       "2  0.247676 -1.514654  ...    0.247998  0.771679  0.909412 -0.689281   \n",
       "3  0.377436 -1.387024  ...   -0.108300  0.005274 -0.190321 -1.175575   \n",
       "4 -0.270533  0.817739  ...   -0.009431  0.798278 -0.137458  0.141267   \n",
       "\n",
       "        V25       V26       V27       V28    Amount  Fraud  \n",
       "0  0.128539 -0.189115  0.133558 -0.021053  0.244964      0  \n",
       "1  0.167170  0.125895 -0.008983  0.014724 -0.342475      0  \n",
       "2 -0.327642 -0.139097 -0.055353 -0.059752  1.160686      0  \n",
       "3  0.647376 -0.221929  0.062723  0.061458  0.140534      0  \n",
       "4 -0.206010  0.502292  0.219422  0.215153 -0.073403      0  \n",
       "\n",
       "[5 rows x 31 columns]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# First 5 rows\n",
    "cred_data.head(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x1047957b8>"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZMAAAEFCAYAAAAmIwo/AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAFaRJREFUeJzt3X1QVPe9x/HPsotR2SXAaBoZAwGj\nMcanYaj09qJz7xiKttXUXByVOyRXbBIdH8LclEpQQWeJ2jghTfEB4x9ppq2txaQp00ljKomhUCup\nGTRsqzFzkQR1Wo1mAksU5Jz7R8dtTCKs/vZB5P2ayQx7+HH47kzG956zh7MO27ZtAQBgICbaAwAA\nBj5iAgAwRkwAAMaICQDAGDEBABhzRXuAaDh7tiPaIwDAgDNypOea3+PIBABgjJgAAIwREwCAMWIC\nADBGTAAAxogJAMAYMQEAGCMmAABjxAQAYGxQ/gU8ANzs3n33L9qwYa3uuislsO3JJ0uUlpZutN/8\n/P/S7t0vm473JcTkBj2xpTbaI9w0ni+eG+0RgFtSdvYMFReXRnuMoBATABggVqx4TImJSYqLi9ND\nD83X9u0/UW9vr2zb1ubNlaqvf0sff/yxCgr+R++++xfV1b2h4uJSVVVV6r33jhof1fSFmADATaqh\noV5tbSclSffee58kad68PGVkZOqNN15XSck63XnnKD3zzNM6erT5K/dx4sT7OnWqXS+88FO9//4x\nvffekbDMSkwA4Cb1xdNcK1Y8ppSUVEnSiBEjVF29VbfddptaW/9P3/jGv3/lPj788KTGjRsvSRo3\nbrxuu+22sMzK1VwAMIA4HA5J0k9+UqlVq/5XJSXrFBcXJ9u2NWTIEF248LEk6cSJ45Kk0aNT9Le/\n+SRJbW0n1d3dHZa5ODIBgAFo5sxvadWqpfJ4PBo2LE4ff3xODzzwLb3ySo1WrnxcqalpkqR77x2v\nSZOm6NFHH1Fq6t0aNmx4WOZx2LZth2XPN7FQfDgWV3P9C1dzAYMDH44FAAgrYgIAMEZMAADGiAkA\nwBgxAQAY49JgAIiyUF8dGo0rLIkJAAwylmXp2Wc364MPTig2NlYlJes0evRdRvvkNBcADDJ//OMB\ndXd3a+fOF7V06Upt3fqc8T6JCQAMMkePNisr698kSRMnTtKxY38z3icxAYBBxu/3Ky7OHXgcExOj\ny5cvG+2TmADAIBMXF6eurq7AY9u25XKZvYVOTABgkJk0aYr+/OdGSVJLy3tKT7/HeJ9czQUAURbp\nS3lnzPhPvfPOIS1dWijbtlVaWm68T2ICAINMTExMyD9bntNcAABjYTky6enpUWlpqU6dOqXu7m4t\nW7ZMd955p5YuXaq7775bkrRo0SJ9+9vf1tatW3XgwAG5XC6VlpZq8uTJamtrU0lJiRwOh8aOHavy\n8nLFxMRc11oAQOSEJSa1tbVKSEjQli1bdOHCBc2bN0/Lly/X4sWLVVhYGFjn8/nU1NSkmpoanTlz\nRitXrtTLL7+sTZs2qaioSFlZWSorK1NdXZ2Sk5ODXpuTkxOOpwUAuIawxGTWrFnKzc0NPHY6nWpp\naVFra6vq6uqUmpqq0tJSHT58WNnZ2XI4HEpOTlZvb6/Onz8vn8+nadOmSZJmzJihxsZGpaWlBb2W\nmABAZIUlJnFxcZKkzs5OrVq1SkVFReru7tb8+fM1ceJE7dixQ9u2bZPH41FCQsJVP9fR0SHbtuVw\nOK7a1tnZGfTa/iQmDpfL5QzlUx7U+vooTwCDQ9iu5jpz5oyWL1+u/Px8zZkzR59++qni4+MlSTk5\nOfJ6vZo5c6b8fn/gZ/x+vzwez1Xvefj9fsXHx8vtdge9tj8XLnT1uwbBO3u2/4ADuLbi360N6f62\nfLcipPu7IuKfAX/u3DkVFhaquLhYeXl5kqQlS5bo6NGjkqSDBw/q/vvvV0ZGhhoaGmRZlk6fPi3L\nspSUlKQJEybo0KFDkqT6+nplZmZe11oAQP98vhatWPFYSPYVliOT6upqffrpp9q+fbu2b98uSSop\nKdHGjRsVGxurESNGyOv1yu12KzMzUwsWLJBlWSorK5MkrV69WuvWrVNlZaXS09OVm5srp9MZ9FoA\nQN9+8YuXtG/faxo6dFhI9uewbdsOyZ4GkFCclgn1h9kMZNH4IB7gVhKN01wHDtRpzJix8nrL9MIL\nPw1qvxE/zQUAuLn9x3/MNL654+cREwCAMWICADDGjR4BIMrCdSlvJHFkAgCD1KhRyUG/+d4fYgIA\nMEZMAADGiAkAwBgxAQAYIyYAAGPEBABgjJgAAIwREwCAMWICADBGTAAAxogJAMAYMQEAGCMmAABj\nxAQAYIyYAACMERMAgDFiAgAwRkwAAMaICQDAGDEBABgjJgAAY8QEAGCMmAAAjLnCsdOenh6Vlpbq\n1KlT6u7u1rJly3TPPfeopKREDodDY8eOVXl5uWJiYrR161YdOHBALpdLpaWlmjx5stra2ozXAgAi\nJyz/6tbW1iohIUG7d+/Wrl275PV6tWnTJhUVFWn37t2ybVt1dXXy+XxqampSTU2NKisrtWHDBkky\nXgsAiKywHJnMmjVLubm5gcdOp1M+n0/Tpk2TJM2YMUONjY1KS0tTdna2HA6HkpOT1dvbq/Pnzxuv\nzcnJCcfTAgBcQ1hiEhcXJ0nq7OzUqlWrVFRUpB/96EdyOByB73d0dKizs1MJCQlX/VxHR4ds2zZa\n25/ExOFyuZwhe76D3ciRnmiPACDKwhITSTpz5oyWL1+u/Px8zZkzR1u2bAl8z+/3Kz4+Xm63W36/\n/6rtHo/nqvc8bmRtfy5c6DJ9evics2f7DziAga+vF45hec/k3LlzKiwsVHFxsfLy8iRJEyZM0KFD\nhyRJ9fX1yszMVEZGhhoaGmRZlk6fPi3LspSUlGS8FgAQWQ7btu1Q77SiokK///3vlZ6eHti2Zs0a\nVVRUqKenR+np6aqoqJDT6VRVVZXq6+tlWZaeeuopZWZmqrW1VevWrTNa25dQvJJ+Ykut8T5uFc8X\nz432CAAioK8jk7DE5GZHTEKLmACDQ8RPcwEABhdiAgAwRkwAAMaICQDAGDEBABgjJgAAY8QEAGCM\nmAAAjBETAIAxYgIAMEZMAADGiAkAwBgxAQAYIyYAAGPEBABgjJgAAIwREwCAMWICADBGTAAAxogJ\nAMAYMQEAGAsqJl6v90vbVq9eHfJhAAADk6uvb65Zs0YfffSRWlpadOLEicD2y5cvq6OjI+zDAQAG\nhj5jsmzZMp06dUpPP/20VqxYEdjudDo1ZsyYsA8HABgY+ozJ6NGjNXr0aNXW1qqzs1MdHR2ybVuS\n1NXVpYSEhIgMCQC4ufUZkyt27typnTt3XhUPh8Ohurq6sA0GABg4gopJTU2N9u/fr6SkpHDPAwAY\ngIK6mmvUqFG6/fbbwz0LAGCACurI5O6771Z+fr6ysrI0ZMiQwPbPvykPABi8gjoy+drXvqbp06df\nFZJgHDlyRAUFBZIkn8+n6dOnq6CgQAUFBXrttdckSVu3blVeXp4WLlyoo0ePSpLa2tq0aNEi5efn\nq7y8XJZlXfdaAEDkBHVkciNHILt27VJtba2GDRsmSfrrX/+qxYsXq7CwMLDG5/OpqalJNTU1OnPm\njFauXKmXX35ZmzZtUlFRkbKyslRWVqa6ujolJycHvTYnJ+e65wUA3LigYjJ+/Hg5HI6rtt1xxx16\n++23r/kzKSkpqqqq0g9/+ENJUktLi1pbW1VXV6fU1FSVlpbq8OHDys7OlsPhUHJysnp7e3X+/Hn5\nfD5NmzZNkjRjxgw1NjYqLS0t6LXEBAAiK6iYHDt2LPB1T0+P9u/fr+bm5j5/Jjc3V+3t7YHHkydP\n1vz58zVx4kTt2LFD27Ztk8fjuepy47i4uMDfslyJ15VtnZ2dQa/tT2LicLlczmCeOoIwcqQn2iMA\niLKgYvJ5sbGxmj17tqqrq6/r53JychQfHx/42uv1aubMmfL7/YE1fr9fHo9HMTExV22Lj4+X2+0O\nem1/Llzouq7Z0bezZ7m1DjAY9PXCMag34F999dXAf7/5zW/0zDPPyOW6vg4tWbIk8Kb5wYMHdf/9\n9ysjI0MNDQ2yLEunT5+WZVlKSkrShAkTdOjQIUlSfX29MjMzr2stACCygirClX+sr0hMTNSPf/zj\n6/pF69evl9frVWxsrEaMGCGv1yu3263MzEwtWLBAlmWprKxM0j/vSLxu3TpVVlYqPT1dubm5cjqd\nQa8FAESWw75ys61+9PT0qLW1Vb29vRo7dux1H5ncTEJxWuaJLbUhmOTW8Hzx3GiPACAC+jrNFVQR\nWlpatGrVKiUkJMiyLJ07d07btm3TlClTQjYkAGDgCiomFRUVeu655wLxaG5ultfr1d69e8M6HABg\nYAjqDfiurq6rjkKmTp2qS5cuhW0oAMDAElRMbr/9du3fvz/weP/+/XyWCQAgIKjTXF6vV48//rjW\nrFkT2ParX/0qbEMBAAaWoI5M6uvrNWzYML311lt66aWXlJSUpKampnDPBgAYIIKKya9//Wv98pe/\n1PDhwzV+/Hi98sor+vnPfx7u2QAAA0RQMenp6VFsbGzg8ee/BgAgqPdMHnjgAT3yyCOaPXu2HA6H\n9u3bp5kzZ4Z7NgDAABFUTIqLi/X666/rnXfekcvl0sMPP6wHHngg3LMBAAaIoO+JMmvWLM2aNSuc\nswAABqig3jMBAKAvxAQAYIyYAACMERMAgDFiAgAwRkwAAMaICQDAGDEBABgjJgAAY8QEAGCMmAAA\njBETAIAxYgIAMEZMAADGiAkAwBgxAQAYIyYAAGNhjcmRI0dUUFAgSWpra9OiRYuUn5+v8vJyWZYl\nSdq6davy8vK0cOFCHT16NGRrAQCRE7aY7Nq1S2vXrtWlS5ckSZs2bVJRUZF2794t27ZVV1cnn8+n\npqYm1dTUqLKyUhs2bAjJWgBAZIUtJikpKaqqqgo89vl8mjZtmiRpxowZ+tOf/qTDhw8rOztbDodD\nycnJ6u3t1fnz543XAgAiyxWuHefm5qq9vT3w2LZtORwOSVJcXJw6OjrU2dmphISEwJor203X9icx\ncbhcLmdIniekkSM90R4BQJSFLSZfFBPzr4Mgv9+v+Ph4ud1u+f3+q7Z7PB7jtf25cKHL9Ongc86e\n7T/gAAa+vl44RuxqrgkTJujQoUOSpPr6emVmZiojI0MNDQ2yLEunT5+WZVlKSkoyXgsAiKyIHZms\nXr1a69atU2VlpdLT05Wbmyun06nMzEwtWLBAlmWprKwsJGsBAJHlsG3bjvYQkRaK0zJPbKkNwSS3\nhueL50Z7BAARcFOc5gIA3LqICQDAGDEBABgjJgAAY8QEAGCMmAAAjBETAIAxYgIAMEZMAADGiAkA\nwBgxAQAYIyYAAGPEBABgjJgAAIwREwCAMWICADBGTAAAxogJAMAYMQEAGCMmAABjxAQAYIyYAACM\nERMAgDFiAgAwRkwAAMaICQDAGDEBABgjJgAAY8QEAGDMFelf+L3vfU8ej0eSNHr0aC1YsEBPP/20\nnE6nsrOztWLFClmWpfXr1+v48eMaMmSIKioqlJqaqubm5qDXAgAiJ6IxuXTpkiTpZz/7WWDbgw8+\nqKqqKt1111167LHH5PP5dOrUKXV3d2vPnj1qbm7W5s2btWPHDpWXlwe9FgAQORGNybFjx/TZZ5+p\nsLBQly9f1sqVK9Xd3a2UlBRJUnZ2tg4ePKizZ89q+vTpkqSpU6eqpaVFnZ2dQa/tT2LicLlczjA9\ny8Fn5EhPtEcAEGURjcnQoUO1ZMkSzZ8/XydPntSjjz6q+Pj4wPfj4uL00UcfqbOzU263O7Dd6XR+\naVtfay9fviyX69pP7cKFrhA/s8Ht7NmOaI8AIAL6euEY0ZikpaUpNTVVDodDaWlp8ng8+uSTTwLf\n9/v9io+P18WLF+X3+wPbLcuS2+2+altfa/sKCQAg9CJ6NdfevXu1efNmSdLf//53ffbZZxo+fLg+\n/PBD2bathoYGZWZmKiMjQ/X19ZKk5uZmjRs3Tm63W7GxsUGtBQBEVkRfwufl5empp57SokWL5HA4\ntHHjRsXExOgHP/iBent7lZ2drSlTpmjSpElqbGzUwoULZdu2Nm7cKEnasGFD0GsBAJHjsG3bjvYQ\nkRaKc/xPbKkNwSS3hueL50Z7BAAR0Nd7JvzRIgDAGDEBABgjJgAAY8QEAGCMmAAAjBETAIAxYgIA\nMEZMAADGiAkAwBgxAQAYIyYAAGPEBABgjJgAAIwREwCAMWICADBGTAAAxogJAMAYMQEAGCMmAABj\nxAQAYIyYAACMERMAgDFiAgAwRkwAAMaICQDAGDEBABgjJgAAY8QEAGDMFe0BQsGyLK1fv17Hjx/X\nkCFDVFFRodTU1GiPBQCDxi1xZLJ//351d3drz549evLJJ7V58+ZojwQAg8otcWRy+PBhTZ8+XZI0\ndepUtbS0RHkiADeD4t+tjfYIN40t360I6/5viZh0dnbK7XYHHjudTl2+fFku11c/vZEjPca/c/cz\n/228DwDh9dPFz0d7hEHjljjN5Xa75ff7A48ty7pmSAAAoXdLxCQjI0P19fWSpObmZo0bNy7KEwHA\n4OKwbduO9hCmrlzN9f7778u2bW3cuFFjxoyJ9lgAMGjcEjEBAETXLXGaCwAQXcQEAGCMmAAAjBET\n3DDLslRWVqYFCxaooKBAbW1t0R4JuMqRI0dUUFAQ7TEGBf4YAzfs87exaW5u1ubNm7Vjx45ojwVI\nknbt2qXa2loNGzYs2qMMChyZ4IZxGxvczFJSUlRVVRXtMQYNYoIbdq3b2AA3g9zcXO6EEUHEBDeM\n29gAuIKY4IZxGxsAV/AyEjcsJydHjY2NWrhwYeA2NgAGJ26nAgAwxmkuAIAxYgIAMEZMAADGiAkA\nwBgxAQAY49JgIEza29s1a9asL33qZ3V1tUaNGhWy33Pvvffq+PHjIdsfcCOICRBGd9xxh377299G\newwg7IgJEGElJSX65JNP1NbWpuLiYl26dEkvvviiLl68qO7ubm3cuFEZGRkqKCjQihUrlJWVpfb2\ndj388MN688031d7eruLiYnV1dWnKlCnRfjqAJGIChNU//vEPPfjgg4HHc+bMkSQlJCSourpalmVp\n8eLFqq6uVlJSkvbu3asXXnhB1dXV19yn1+vVQw89pPnz5+vVV1/Vnj17wv48gP4QEyCMvuo0V0lJ\niSZPnixJiomJ0bZt2/Tmm2+qtbVVTU1Nionp+7qYpqYmPfvss5KkuXPnau3ateEZHrgOXM0FRMHQ\noUMlSX6/X3l5eWpvb9fXv/71L30q4JW7HX3x1v5Xtjscjn7jA0QC/xcCUXTy5Ek5HA4tXbpUWVlZ\n+sMf/qDe3l5JUmJioj744ANJ//xUyyu++c1vqra2VpL0xhtv6NKlS5EfHPgCYgJE0fjx43Xfffdp\n9uzZ+s53vqPExESdPn1akvT9739fu3fv1rx583Tx4sXAz5SVlWnfvn2aO3eu3n77bcXFxUVrfCCA\nuwYDAIxxZAIAMEZMAADGiAkAwBgxAQAYIyYAAGPEBABgjJgAAIz9PySoODLs3LfmAAAAAElFTkSu\nQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x104795908>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Checking the target class\n",
    "sns.countplot(x=\"Fraud\",data=cred_data,hue=\"Fraud\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Supervised learning\n",
    "\n",
    "## k-Nearest Neighbors\n",
    "Basic idea: Predict the label of a data point by\n",
    "- Looking at the ‘k’ closest labeled data points\n",
    "- Taking a majority vote\n",
    "\n",
    "<img src=\"http://scikit-learn.org/stable/_images/sphx_glr_plot_classification_001.png\" width=\"400\">\n",
    "\n",
    "source:\n",
    "*http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html#sphx-glr-auto-examples-neighbors-plot-classification-py*.\n",
    "*https://www.datacamp.com*\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Import modules"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.neighbors import KNeighborsClassifier"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Define Features\n",
    "        Supervised learning consists in learning the link between two datasets: the observed data X and an external variable y that we are trying to predict, usually called “target” or “labels”. Most often, y is a 1D array of length n_samples.\n",
    "        All supervised estimators in scikit-learn implement a fit(X, y) method to fit the model and a predict(X) method that, given unlabeled observations X, returns the predicted labels y.\n",
    "\n",
    "source:\n",
    "*http://scikit-learn.org/stable/modules/neighbors.html#nearest-neighbors-classification*."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "# labels\n",
    "y_target = cred_data['Fraud']\n",
    "\n",
    "# unlabeled observations\n",
    "X_data = cred_data.drop(['Fraud'], axis=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Measuring model performance\n",
    "- In classification, accuracy is a commonly used metric \n",
    "- Accuracy = Fraction of correct predictions\n",
    "- Split data into training and test set\n",
    " - Fit/train the classifier on the training set\n",
    " - Make predictions on test set\n",
    " - Compare predictions with the known labels\n",
    "\n",
    "source: *https://www.datacamp.com*"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Train/test split"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Import Modules"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.model_selection import train_test_split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train,X_test,y_train,y_test = train_test_split(X_data,y_target,test_size=0.3,\n",
    "                                                random_state=21,stratify=y_target)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Fit a classifier\n",
    "    Training a model on the data = ‘fiting’ a model to the data: \n",
    "- .fit() method\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "KNeighborsClassifier(algorithm='auto', leaf_size=30, metric='minkowski',\n",
       "           metric_params=None, n_jobs=1, n_neighbors=3, p=2,\n",
       "           weights='uniform')"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# I chose an odd value in K to avoid tie in the vote.\n",
    "knn = KNeighborsClassifier(n_neighbors=3)\n",
    "\n",
    "# fit() method\n",
    "knn.fit(X_train , y_train)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Predicting on unlabeled data\n",
    "    To predict the labels of new data: \n",
    "- .predict() method"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_pred = knn.predict(X_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Accuracy"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.99852533267792565"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "knn.score(X_test, y_test)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}