Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO
Authors:
- 7 September 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 17 (11) , 1936-1948
Abstract
Heterogeneous feature representations are widely used in machine learning and pattern recognition, especially for multimedia analysis. The multi-modal, often also high- dimensional , features may contain redundant and irrelevant information that can deteriorate the performance of modeling in classification. It is a challenging problem to select the informative features for a given task from the redundant and heterogeneous feature groups. In this paper, we propose a novel framework to address this problem. This framework is composed of two modules, namely, multi-modal deep neural networks and feature selection with sparse group LASSO. Given diverse groups of discriminative features, the proposed technique first converts the multi-modal data into a unified representation with different branches of the multi-modal deep neural networks. Then, through solving a sparse group LASSO problem, the feature selection component is used to derive a weight vector to indicate the importance of the feature groups. Finally, the feature groups with large weights are considered more relevant and hence are selected. We evaluate our framework on three image classification datasets. Experimental results show that the proposed approach is effective in selecting the relevant feature groups and achieves competitive classification performance as compared with several recent baseline methods.Keywords
Funding Information
- 973 Program (2013CB329304)
- 973 Program (61222210, 61432011)
This publication has 40 references indexed in Scilit:
- Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancerThe Annals of Applied Statistics, 2010
- Neighborhood rough set based heterogeneous feature subset selectionInformation Sciences, 2008
- Convex multi-task feature learningMachine Learning, 2008
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Feature fusion: parallel strategy vs. serial strategyPattern Recognition, 2003
- Texture features for browsing and retrieval of image dataIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996