Classification assessment methods
Author:
Top Cited Papers
Open Access
- 30 July 2020
- journal article
- research article
- Published by Emerald Publishing in Applied Computing and Informatics
- Vol. 17 (1) , 168-192
Abstract
Classification techniques have been applied to many applications in various fields of sciences. There are several ways of evaluating classification algorithms. The analysis of such metrics and its significance must be interpreted correctly for evaluating different learning algorithms. Most of these measures are scalar metrics and some of them are graphical methods. This paper introduces a detailed overview of the classification assessment measures with the aim of providing the basics of these measures and to show how it works to serve as a comprehensive source for researchers who are interested in this field. This overview starts by highlighting the definition of the confusion matrix in binary and multi-class classification problems. Many classification measures are also explained in details, and the influence of balanced and imbalanced data on each metric is presented. An illustrative example is introduced to show (1) how to calculate these measures in binary and multi-class classification problems, and (2) the robustness of some measures against balanced and imbalanced data. Moreover, some graphical measures such as Receiver operating characteristics (ROC), Precision-Recall, and Detection error trade-off (DET) curves are presented with details. Additionally, in a step-by-step approach, different numerical examples are demonstrated to explain the preprocessing steps of plotting ROC, PR, and DET curves.Keywords
This publication has 16 references indexed in Scilit:
- Adjusted F-measure and kernel scaling for imbalanced data learningInformation Sciences, 2014
- An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristicsInformation Sciences, 2013
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009
- An introduction to ROC analysisPattern Recognition Letters, 2006
- The relationship between Precision-Recall and ROC curves2006
- Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation2006
- Diagnostic tests 4: likelihood ratiosBMJ, 2004
- The use of the area under the ROC curve in the evaluation of machine learning algorithmsPattern Recognition, 1997
- Basic principles of ROC analysisSeminars in Nuclear Medicine, 1978
- Comparison of the predicted and observed secondary structure of T4 phage lysozymeBiochimica et Biophysica Acta (BBA) - Protein Structure, 1975