Multi-Dimensional Classification with Super-Classes
Open Access
- 25 October 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 26 (7) , 1720-1733
Abstract
The multi-dimensional classification problem is a generalization of the recently-popularized task of multi-label classification, where each data instance is associated with multiple class variables. There has been relatively little research carried out specific to multi-dimensional classification and, although one of the core goals is similar (modeling dependencies among classes), there are important differences; namely a higher number of possible classifications. In this paper we present method for multi-dimensional classification, drawing from the most relevant multi-label research, and combining it with important novel developments. Using a fast method to model the conditional dependence between class variables, we form super-class partitions and use them to build multi-dimensional learners, learning each super-class as an ordinary class, and thus explicitly modeling class dependencies. Additionally, we present a mechanism to deal with the many class values inherent to super-classes, and thus make learning efficient. To investigate the effectiveness of this approach we carry out an empirical evaluation on a range of multi-dimensional datasets, under different evaluation metrics, and in comparison with high-performing existing multi-dimensional approaches from the literature. Analysis of results shows that our approach offers important performance gains over competing methods, while also exhibiting tractable running time.Keywords
This publication has 12 references indexed in Scilit:
- Markov blanket-based approach for learning multi-dimensional Bayesian network classifiers: An application to predict the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson’s Disease Questionnaire (PDQ-39)Journal of Biomedical Informatics, 2012
- An extensive experimental comparison of methods for multi-label learningPattern Recognition, 2012
- Multi-dimensional classification with Bayesian networksInternational Journal of Approximate Reasoning, 2011
- Classifier chains for multi-label classificationMachine Learning, 2011
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Combining instance-based learning and logistic regression for multilabel classificationMachine Learning, 2009
- Multi-label Classification Using Ensembles of Pruned Sets2008
- An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and VariantsMachine Learning, 1999
- Bagging predictorsMachine Learning, 1996
- Optimization by Simulated AnnealingScience, 1983