Hierarchical Nuclear Norm Penalization for Multi-View Data Integration
Open Access
- 22 June 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 79 (4) , 2933-2946
Abstract
The prevalence of data collected on the same set of samples from multiple sources (i.e., multi-view data) has prompted significant development of data integration methods based on low-rank matrix factorizations. These methods decompose signal matrices from each view into the sum of shared and individual structures, which are further used for dimension reduction, exploratory analyses, and quantifying associations across views. However, existing methods have limitations in modeling partially-shared structures due to either too restrictive models, or restrictive identifiability conditions. To address these challenges, we propose a new formulation for signal structures that include partially-shared signals based on grouping the views into so-called hierarchical levels with identifiable guarantees under suitable conditions. The proposed hierarchy leads us to introduce a new penalty, hierarchical nuclear norm (HNN), for signal estimation. In contrast to existing methods, HNN penalization avoids scores and loadings factorization of the signals and leads to a convex optimization problem, which we solve using a dual forward–backward algorithm. We propose a simple refitting procedure to adjust the penalization bias and develop an adapted version of bi-cross-validation for selecting tuning parameters. Extensive simulation studies and analysis of the genotype-tissue expression data demonstrate the advantages of our method over existing alternatives.Keywords
All Related Versions
Funding Information
- National Science Foundation (CCF-1934904, DMS-2044823)
- National Science Foundation (CCF‐1934904, DMS‐2044823)
This publication has 27 references indexed in Scilit:
- Proximal Algorithms in Statistics and Machine LearningStatistical Science, 2015
- A non-negative matrix factorization method for detecting modules in heterogeneous omics multi-modal dataBioinformatics, 2015
- Adaptive shrinkage of singular valuesStatistics and Computing, 2015
- Reduced rank regression via adaptive nuclear norm penalizationBiometrika, 2013
- Joint and individual variation explained (JIVE) for integrated analysis of multiple data typesThe Annals of Applied Statistics, 2013
- A flexible framework for sparse simultaneous component based data integrationBMC Bioinformatics, 2011
- Estimation of (near) low-rank matrices with noise and high-dimensional scalingThe Annals of Statistics, 2011
- Bi-cross-validation of the SVD and the nonnegative matrix factorizationThe Annals of Applied Statistics, 2009
- Exact Matrix Completion via Convex OptimizationFoundations of Computational Mathematics, 2009
- A framework for sequential multiblock component methodsJournal of Chemometrics, 2003