Classifying highly imbalanced ICU data
- 31 May 2013
- journal article
- research article
- Published by Springer Nature in Health Care Management Science
- Vol. 16 (2) , 119-128
Abstract
Highly imbalanced data sets are those where the class of interest is rare. In this paper, we compare the performance of several common data mining methods, logistic regression, discriminant analysis, Classification and Regression Tree (CART) models, C5, and Support Vector Machines (SVM) in predicting the discharge status (alive or deceased, with "deceased" being the class of interest) of patients from an Intensive Care Unit (ICU). Using a variety of misclassification cost ratio (MCR) values and using specificity, recall, precision, the F-measure, and confusion entropy (CEN) as criteria for evaluating each method's performance, C5 and SVM performed better than the other methods. At a MCR of 100, C5 had the highest recall and SVM the highest specificity and lowest CEN. We also used Hand's measure to compare the five methods. According to Hand's measure, logistic regression performed the best. This article makes several contributions. We show how the use of MCR for analyzing imbalanced medical data significantly improves the method's classification performance. We also found that the F-measure and precision did not improve as the MCR was increased.Keywords
This publication has 16 references indexed in Scilit:
- A novel measure for evaluating classifiersExpert Systems with Applications, 2010
- Evaluating diagnostic tests: The area under the ROC curve and the balance of errorsStatistics in Medicine, 2010
- Toward breast cancer survivability prediction models through improving training spaceExpert Systems with Applications, 2009
- Knowledge discovery from imbalanced and noisy dataData & Knowledge Engineering, 2009
- Cluster-based under-sampling approaches for imbalanced data distributionsExpert Systems with Applications, 2009
- Handling class imbalance in customer churn predictionExpert Systems with Applications, 2009
- Adaptive Weighted Learning for Unbalanced Multicategory ClassificationBiometrics, 2009
- Imbalanced text classification: A term weighting approachExpert Systems with Applications, 2009
- Neighbor-weighted K-nearest neighbor for unbalanced text corpusExpert Systems with Applications, 2005
- EditorialACM SIGKDD Explorations Newsletter, 2004