Online Distributed Sparsity-Aware Canonical Correlation Analysis
Authors:
Open Access
- 24 September 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 64 (3) , 688-703
Abstract
The problem of identifying informative sensors that acquire measurements about multiple sources and clustering them according to their source content is considered. Toward this end, a novel canonical correlation analysis (CCA) framework equipped with sparsity-inducing norm-one regularization is introduced to identify correlated sensor measurements and identify informative groups of sensors. It is established that the novel framework is capable to cluster sensors, based on their source content, correctly (with probability one) even in nonlinear settings and when sources do not overlap. Block coordinate techniques are employed to derive a centralized algorithm that minimizes the sparsity-aware CCA framework. The latter framework is reformulated as a separable optimization program which is tackled in a distributed fashion via the alternating direction method of multipliers. A computationally efficient online distributed algorithm is further derived that is capable to process sensor data online. Extensive numerical tests corroborate that the novel techniques outperform existing alternatives.Keywords
Funding Information
- National Science Foundation (CCF 1218019)
This publication has 24 references indexed in Scilit:
- A multivariate regression approach to association analysis of a quantitative trait networkBioinformatics, 2009
- The Elements of Statistical Learning2009
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Sparse Principal Component AnalysisJournal of Computational and Graphical Statistics, 2006
- Survey of Clustering AlgorithmsIEEE Transactions on Neural Networks, 2005
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- On Clustering Validation TechniquesJournal of Intelligent Information Systems, 2001
- Data clusteringACM Computing Surveys, 1999
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982
- Relations Between Two Sets of VariatesBiometrika, 1936