Treating Class Imbalance in Non-Technical Loss Detection: An Exploratory Analysis of a Real Dataset
Open Access
- 6 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 98928-98938
Abstract
Non-Technical Loss (NTL) is a significant concern for many electric supply companies due to the financial impact caused as a result of suspect consumption activities. A range of machine learning classifiers have been tested across multiple synthesized and real datasets to combat NTL. An important characteristic that exists in these datasets is the imbalance distribution of the classes. When the focus is on predicting the minority class of suspect activities, the classifiers’ sensitivity to the class imbalance becomes more important. In this paper, we evaluate the performance of a range of classifiers with under-sampling and over-sampling techniques. The results are compared with the untreated imbalanced dataset. In addition, we compare the performance of the classifiers using penalized classification model. Lastly, the paper presents an exploratory analysis of using different sampling techniques on NTL detection in a real dataset and identify the best performing classifiers. We conclude that logistic regression is the most sensitive to the sampling techniques as the change of its recall is measured around 50% for all sampling techniques. While the random forest is the least sensitive to the sampling technique, the difference in its precision is observed between 1% – 6% for all sampling techniques.Keywords
Funding Information
- European Union and the European Social Fund (EFOP-3.6.1-16-2016-00022)
- Deanship of Scientific Research at King Saud University through Research Group (RG-1441-490)
This publication has 29 references indexed in Scilit:
- Wide and Deep Convolutional Neural Networks for Electricity-Theft Detection to Secure Smart GridsIEEE Transactions on Industrial Informatics, 2017
- Identification of the characteristics incident to the detection of non-technical losses for two Colombian energy companiesRevista Facultad de Ingeniería Universidad de Antioquia, 2017
- Detection of non-technical losses using advanced metering infrastructure and deep recurrent neural networks2017
- Learning from class-imbalanced data: Review of methods and applicationsExpert Systems with Applications, 2017
- Physical activity classification using body-worn inertial sensors in a multi-sensor setup2016
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- A Multiple Expert Approach to the Class Imbalance Problem Using Inverse Random under Sampling2009
- An information granulation based data mining approach for classifying imbalanced dataInformation Sciences, 2008
- Theoretical Comparison between the Gini Index and Information Gain CriteriaAnnals of Mathematics and Artificial Intelligence, 2004
- Learning with Rare Cases and Small Disjuncts1995