Multilabel Classification Using Error-Correcting Codes of Hard or Soft Bits
Authors:
- 3 July 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 24 (11) , 1888-1900
Abstract
We formulate a framework for applying error-correcting codes (ECCs) on multilabel classification problems. The framework treats some base learners as noisy channels and uses ECC to correct the prediction errors made by the learners. The framework immediately leads to a novel ECC-based explanation of the popular random k-label sets (RAKEL) algorithm using a simple repetition ECC. With the framework, we empirically compare a broad spectrum of off-the-shelf ECC designs for multilabel classification. The results not only demonstrate that RAKEL can be improved by applying some stronger ECC, but also show that the traditional binary relevance approach can be enhanced by learning more parity-checking labels. Our research on different ECCs also helps to understand the tradeoff between the strength of ECC and the hardness of the base learning tasks. Furthermore, we extend our research to ECC with either hard (binary) or soft (real-valued) bits by designing a novel decoder. We demonstrate that the decoder improves the performance of our framework.Keywords
This publication has 13 references indexed in Scilit:
- Discriminative Least Squares Regression for Multiclass Classification and Feature SelectionIEEE Transactions on Neural Networks and Learning Systems, 2012
- Multilabel Classification with Principal Label Space TransformationNeural Computation, 2012
- Multilabel Classification Using Error Correction Codes2010
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- Multilabel classification via calibrated label rankingMachine Learning, 2008
- Multiclass boosting with repartitioning2006
- Learning multi-label scene classificationPattern Recognition, 2004
- On a class of error correcting binary group codesInformation and Control, 1960
- Error Detecting and Error Correcting CodesBell System Technical Journal, 1950
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948