|
| 1 | +# Fraud detection in credit cards based on binary classification and PCA |
| 2 | + |
| 3 | +| ML.NET version | API type | Status | App Type | Data type | Scenario | ML Task | Algorithms | |
| 4 | +|----------------|-------------------|-------------------------------|-------------|-----------|---------------------|---------------------------|-----------------------------| |
| 5 | +| v0.10 | Dynamic API | Up-to-date | Two console apps | .csv file | Fraud Detection | Two-class classification | FastTree Binary Classification | |
| 6 | + |
| 7 | +In this introductory sample, you'll see how to use ML.NET to predict a credit card fraud. In the world of machine learning, this type of prediction is known as binary classification. |
| 8 | + |
| 9 | +## API version: Dynamic and Estimators-based API |
| 10 | +It is important to note that this sample uses the dynamic API with Estimators. |
| 11 | + |
| 12 | +## Problem |
| 13 | +This problem is centered around predicting if credit card transaction (with its related info/variables) is a fraud or no. |
| 14 | + |
| 15 | +The input information of the transactions contain only numerical input variables which are the result of PCA transformations. Unfortunately, due to confidentiality issues, the original features and additional background information are not available, but the way you build the model doesn't change. |
| 16 | + |
| 17 | +Features V1, V2, ... V28 are the principal components obtained with PCA, the only features which have not been transformed with PCA are 'Time' and 'Amount'. |
| 18 | + |
| 19 | +The feature 'Time' contains the seconds elapsed between each transaction and the first transaction in the dataset. The feature 'Amount' is the transaction Amount, this feature can be used for example-dependant cost-sensitive learning. Feature 'Class' is the response variable and it takes value 1 in case of fraud and 0 otherwise. |
| 20 | + |
| 21 | +The dataset is highly unbalanced, the positive class (frauds) account for 0.172% of all transactions. |
| 22 | + |
| 23 | +Using those datasets you build a model that when predicting it will analyze a transaction's input variables and predict a fraud value of false or true. |
| 24 | + |
| 25 | +## DataSet |
| 26 | + |
| 27 | +The training and testing data is based on a public [dataset available at Kaggle](https://www.kaggle.com/mlg-ulb/creditcardfraud) originally from Worldline and the Machine Learning Group (http://mlg.ulb.ac.be) of ULB (Université Libre de Bruxelles), collected and analysed during a research collaboration. |
| 28 | + |
| 29 | +The datasets contains transactions made by credit cards in September 2013 by european cardholders. This dataset presents transactions that occurred in two days, where we have 492 frauds out of 284,807 transactions. |
| 30 | + |
| 31 | +By: Andrea Dal Pozzolo, Olivier Caelen, Reid A. Johnson and Gianluca Bontempi. Calibrating Probability with Undersampling for Unbalanced Classification. In Symposium on Computational Intelligence and Data Mining (CIDM), IEEE, 2015 |
| 32 | + |
| 33 | +More details on current and past projects on related topics are available on http://mlg.ulb.ac.be/BruFence and http://mlg.ulb.ac.be/ARTML |
| 34 | + |
| 35 | +## ML Task - [Binary Classification](https://en.wikipedia.org/wiki/Binary_classification) |
| 36 | + |
| 37 | +Binary or binomial classification is the task of classifying the elements of a given set into two groups (predicting which group each one belongs to) on the basis of a classification rule. Contexts requiring a decision as to whether or not an item has some qualitative property, some specified characteristic |
| 38 | + |
| 39 | +## Solution |
| 40 | + |
| 41 | +To solve this problem, first you need to build a machine learning model. Then you train the model on existing training data, evaluate how good its accuracy is, and lastly you consume the model (deploying the built model in a different app) to predict a fraud for a sample credit card transaction. |
| 42 | + |
| 43 | + |
| 44 | + |
| 45 | + |
| 46 | +### 1. Build model |
| 47 | +Building a model includes: |
| 48 | + |
| 49 | +- Define the data's schema maped to the datasets to read with a DataReader |
| 50 | + |
| 51 | +- Split data for training and tests |
| 52 | + |
| 53 | +- Create an Estimator and transform the data with a ConcatEstimator() and Normalize by Mean Variance. |
| 54 | + |
| 55 | +- Choosing a trainer/learning algorithm (FastTree) to train the model with. |
| 56 | + |
| 57 | + |
| 58 | +The initial code is similar to the following: |
| 59 | + |
| 60 | +`````fsharp |
| 61 | +
|
| 62 | + // Create a common ML.NET context. |
| 63 | + // Seed set to any number so you have a deterministic environment for repeateable results |
| 64 | + let seed = Nullable 1 |
| 65 | + let mlContext = MLContext seed |
| 66 | +
|
| 67 | + let columns = |
| 68 | + [| |
| 69 | + // A boolean column depicting the 'label'. |
| 70 | + yield TextLoader.Column("Label", Nullable DataKind.BL, 30) |
| 71 | + // 29 Features V1..V28 + Amount |
| 72 | + for i in 1 .. 28 -> |
| 73 | + TextLoader.Column(sprintf "V%d" i, Nullable DataKind.R4, i) |
| 74 | + yield TextLoader.Column("Amount", Nullable DataKind.R4, 29) |
| 75 | +
|
| 76 | + let loaderArgs = TextLoader.Arguments() |
| 77 | + loaderArgs.Column <- columns |
| 78 | + loaderArgs.HasHeader <- true |
| 79 | + loaderArgs.Separators <- [| ',' |] |
| 80 | + |
| 81 | +
|
| 82 | +[...] |
| 83 | + let classification = BinaryClassificationCatalog mlContext |
| 84 | + |
| 85 | +[...] |
| 86 | +
|
| 87 | + let trainData, testData = |
| 88 | + classification.TrainTestSplit (data, 0.2) |
| 89 | + |> fun x -> x.ToTuple () |
| 90 | +
|
| 91 | +[...] |
| 92 | +
|
| 93 | + let featureColumnNames = |
| 94 | + trainData.Schema |
| 95 | + |> Seq.map (fun column -> column.Name) |
| 96 | + |> Seq.filter (fun name -> name <> "Label") |
| 97 | + |> Seq.filter (fun name -> name <> "StratificationColumn") |
| 98 | + |> Seq.toArray |
| 99 | +
|
| 100 | + let pipeline = |
| 101 | + mlContext.Transforms.Concatenate ("Features", featureColumnNames) |
| 102 | + |> fun x -> |
| 103 | + x.Append ( |
| 104 | + mlContext.Transforms.Normalize ( |
| 105 | + "FeaturesNormalizedByMeanVar", |
| 106 | + "Features", |
| 107 | + NormalizingEstimator.NormalizerMode.MeanVariance |
| 108 | + ) |
| 109 | + ) |
| 110 | + |> fun x -> |
| 111 | + x.Append ( |
| 112 | + mlContext.BinaryClassification.Trainers.FastTree( |
| 113 | + "Label", |
| 114 | + "Features", |
| 115 | + numLeaves = 20, |
| 116 | + numTrees = 100, |
| 117 | + minDatapointsInLeaves = 10, |
| 118 | + learningRate = 0.2 |
| 119 | + ) |
| 120 | + ) |
| 121 | +
|
| 122 | +````` |
| 123 | + |
| 124 | +### 2. Train model |
| 125 | +Training the model is a process of running the chosen algorithm on a training data (with known fraud values) to tune the parameters of the model. It is implemented in the `Fit()` method from the Estimator object. |
| 126 | + |
| 127 | +To perform training you need to call the `Fit()` method while providing the training dataset (`trainData.csv`) in a DataView object. |
| 128 | + |
| 129 | +`````fsharp |
| 130 | + let model = pipeline.Fit trainData |
| 131 | +````` |
| 132 | + |
| 133 | +### 3. Evaluate model |
| 134 | +We need this step to conclude how accurate our model is. To do so, the model from the previous step is run against another dataset that was not used in training (`testData.csv`). |
| 135 | + |
| 136 | +`Evaluate()` compares the predicted values for the test dataset and produces various metrics, such as accuracy, you can explore. |
| 137 | + |
| 138 | +`````fsharp |
| 139 | + let metrics = classification.Evaluate (model.Transform (testData), "Label") |
| 140 | +````` |
| 141 | + |
| 142 | +### 4. Consume model |
| 143 | +After the model is trained, you can use the `Predict()` API to predict if a transaction is a fraud, using a IDataSet. |
| 144 | + |
| 145 | +`````fsharp |
| 146 | + printfn "Making predictions" |
| 147 | + mlContext.CreateEnumerable<TransactionObservation>(testData, reuseRowObject = false) |
| 148 | + |> Seq.filter (fun x -> x.Label = true) |
| 149 | + // use 5 observations from the test data |
| 150 | + |> Seq.take 5 |
| 151 | + |> Seq.iter (fun testData -> |
| 152 | + let prediction = predictionEngine.Predict testData |
| 153 | + printfn "%A" prediction |
| 154 | + printfn "------" |
| 155 | +````` |
0 commit comments