Multi-dimensional Classification via Selective Feature Augmentation
Open Access
- 21 January 2022
- journal article
- research article
- Published by Springer Nature in Machine Intelligence Research
- Vol. 19 (1) , 38-51
Abstract
In multi-dimensional classification (MDC), the semantics of objects are characterized by multiple class spaces from different dimensions. Most MDC approaches try to explicitly model the dependencies among class spaces in output space. In contrast, the recently proposed feature augmentation strategy, which aims at manipulating feature space, has also been shown to be an effective solution for MDC. However, existing feature augmentation approaches only focus on designing holistic augmented features to be appended with the original features, while better generalization performance could be achieved by exploiting multiple kinds of augmented features. In this paper, we propose the selective feature augmentation strategy that focuses on synergizing multiple kinds of augmented features. Specifically, by assuming that only part of the augmented features is pertinent and useful for each dimension’s model induction, we derive a classification model which can fully utilize the original features while conduct feature selection for the augmented features. To validate the effectiveness of the proposed strategy, we generate three kinds of simple augmented features based on standard kNN, weighted kNN, and maximum margin techniques, respectively. Comparative studies show that the proposed strategy achieves superior performance against both state-of-the-art MDC approaches and its degenerated versions with either kind of augmented features.Keywords
This publication has 30 references indexed in Scilit:
- A scalable pairwise class interaction framework for multidimensional classificationInternational Journal of Approximate Reasoning, 2016
- Hierarchical Multidimensional Classification of Web Documents with MultiWebClass2015
- A Tutorial on Multilabel LearningACM Computing Surveys, 2015
- Efficient monte carlo methods for multi-dimensional learning with classifier chainsPattern Recognition, 2014
- Multi-Dimensional Classification with Super-ClassesIEEE Transactions on Knowledge and Data Engineering, 2013
- A Review on Multi-Label Learning AlgorithmsIEEE Transactions on Knowledge and Data Engineering, 2013
- Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayesian network classifiersArtificial Intelligence in Medicine, 2013
- Multi-dimensional classification with Bayesian networksInternational Journal of Approximate Reasoning, 2011
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Multi-dimensional classification of biomedical text: Toward automated, practical provision of high-utility text to diverse usersBioinformatics, 2008