Belief Combination of Classifiers for Incomplete Data
Authors:
- 9 March 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/CAA Journal of Automatica Sinica
- Vol. 9 (4) , 652-667
Abstract
Data with missing values, or incomplete information, brings some challenges to the development of classification, as the incompleteness may significantly affect the performance of classifiers. In this paper, we handle missing values in both training and test sets with uncertainty and imprecision reasoning by proposing a new belief combination of classifier (BCC) method based on the evidence theory. The proposed BCC method aims to improve the classification performance of incomplete data by characterizing the uncertainty and imprecision brought by incompleteness. In BCC, different attributes are regarded as independent sources, and the collection of each attribute is considered as a subset. Then, multiple classifiers are trained with each subset independently and allow each observed attribute to provide a sub-classification result for the query pattern. Finally, these sub-classification results with different weights (discounting factors) are used to provide supplementary information to jointly determine the final classes of query patterns. The weights consist of two aspects: global and local. The global weight calculated by an optimization function is employed to represent the reliability of each classifier, and the local weight obtained by mining attribute distribution characteristics is used to quantify the importance of observed attributes to the pattern classification. Abundant comparative experiments including seven methods on twelve datasets are executed, demonstrating the out-performance of BCC over all baseline methods in terms of accuracy, precision, recall, F1 measure, with pertinent computational costs.Keywords
Funding Information
- National Natural Science Foundation of China (61300167,61976120)
- Natural Science Foundation of Jiangsu Province (BK20191445)
This publication has 52 references indexed in Scilit:
- Missing data imputation for fuzzy rule-based classification systemsSoft Computing, 2011
- Pattern classification with missing data: a reviewNeural Computing and Applications, 2009
- ECM: An evidential version of the fuzzy c-means algorithmPattern Recognition, 2008
- Handling missing values in support vector machine classifiersNeural Networks, 2005
- A k-nearest neighbor classification rule based on Dempster-Shafer theoryIEEE Transactions on Systems, Man, and Cybernetics, 1995
- The combination of evidence in the transferable belief modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 1990
- On the dempster-shafer framework and new combination rulesInformation Sciences, 1987
- The Treatment of Missing Values in Discriminant Analysis—I. The Sampling ExperimentJournal of the American Statistical Association, 1972
- Upper and Lower Probabilities Induced by a Multivalued MappingThe Annals of Mathematical Statistics, 1967
- Rank Correlation Methods.Biometrika, 1957