Sample-Specific Late Fusion for Visual Category Recognition
Authors:
- Dong LiuDLDong Liu
- Kuan-Ting LaiKLKuan-Ting Lai
- Guangnan YeGYGuangnan Ye
- Ming-Syan ChenMCMing-Syan Chen
- Shih-Fu ChangSCShih-Fu Chang
- 1 June 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 803-810
Abstract
Late fusion addresses the problem of combining the prediction scores of multiple classifiers, in which each score is predicted by a classifier trained with a specific feature. However, the existing methods generally use a fixed fusion weight for all the scores of a classifier, and thus fail to optimally determine the fusion weight for the individual samples. In this paper, we propose a sample-specific late fusion method to address this issue. Specifically, we cast the problem into an information propagation process which propagates the fusion weights learned on the labeled samples to individual unlabeled samples, while enforcing that positive samples have higher fusion scores than negative samples. In this process, we identify the optimal fusion weights for each sample and push positive samples to top positions in the fusion score rank list. We formulate our problem as a L ∞ norm constrained optimization problem and apply the Alternating Direction Method of Multipliers for the optimization. Extensive experiment results on various visual categorization tasks show that the proposed method consistently and significantly beats the state-of-the-art late fusion methods. To the best knowledge, this is the first method supporting sample-specific fusion weight learning.Keywords
This publication has 16 references indexed in Scilit:
- Consumer video understanding2011
- An efficient projection for l 1 , ∞ regularization2009
- Learning instance specific distances using metric propagation2009
- Automated Flower Classification over a Large Number of Classes2008
- Optimal Classifier Fusion in a Non-Bayesian Probabilistic FrameworkIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Likelihood Ratio-Based Biometric Score FusionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Early versus late fusion in semantic video analysis2005
- On Space-Time Interest PointsInternational Journal of Computer Vision, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Modeling the Shape of the Scene: A Holistic Representation of the Spatial EnvelopeInternational Journal of Computer Vision, 2001