Pairwise learning of multilabel classifications with perceptrons
- 1 June 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21614393,p. 2899-2906
Abstract
Multiclass multilabel perceptrons (MMP) have been proposed as an efficient incremental training algorithm for addressing a multilabel prediction task with a team of perceptrons. The key idea is to train one binary classifier per label, as is typically done for addressing multilabel problems, but to make the training signal dependent on the performance of the whole ensemble. In this paper, we propose an alternative technique that is based on a pairwise approach, i.e., we incrementally train a perceptron for each pair of classes. Our evaluation on four multilabel datasets shows that the multilabel pairwise perceptron (MLPP) algorithm yields substantial improvements over MMP in terms of ranking quality and overfitting resistance, while maintaining its efficiency. Despite the quadratic increase in the number of perceptrons that have to be trained, the increase in computational complexity is bounded by the average number of labels per training example.Keywords
This publication has 12 references indexed in Scilit:
- Approximate maximum margin algorithms with rules controlled by the number of mistakes2007
- Multi-label Lazy Associative Classification2007
- On Pairwise Naive Bayes ClassifiersLecture Notes in Computer Science, 2007
- Multilabel Neural Networks with Applications to Functional Genomics and Text CategorizationIEEE Transactions on Knowledge and Data Engineering, 2006
- Training linear SVMs in linear time2006
- A comparison of methods for multiclass support vector machinesIEEE Transactions on Neural Networks, 2002
- Machine learning in automated text categorizationACM Computing Surveys, 2002
- 10.1162/153244302320884605Applied Physics Letters, 2000
- Handwritten digit recognition by neural networks with single-layer trainingIEEE Transactions on Neural Networks, 1992
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958