View selection in multi-view stacking: choosing the meta-learner
Open Access
- 12 April 2024
- journal article
- research article
- Published by Springer Nature in Advances in Data Analysis and Classification
- Vol. 19 (3) , 579-617
Abstract
Multi-view stacking is a framework for combining information from different views (i.e. different feature sets) describing the same set of objects. In this framework, a base-learner algorithm is trained on each view separately, and their predictions are then combined by a meta-learner algorithm. In a previous study, stacked penalized logistic regression, a special case of multi-view stacking, has been shown to be useful in identifying which views are most important for prediction. In this article we expand this research by considering seven different algorithms to use as the meta-learner, and evaluating their view selection and classification performance in simulations and two applications on real gene-expression data sets. Our results suggest that if both view selection and classification accuracy are important to the research at hand, then the nonnegative lasso, nonnegative adaptive lasso and nonnegative elastic net are suitable meta-learners. Exactly which among these three is to be preferred depends on the research context. The remaining four meta-learners, namely nonnegative ridge regression, nonnegative forward selection, stability selection and the interpolating predictor, show little advantages in order to be preferred over the other three.Keywords
All Related Versions
Funding Information
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (639.031.654)
- Universiteit Leiden
This publication has 49 references indexed in Scilit:
- On the Stability of Feature Selection in the Presence of Feature Correlations2020
- Multiview Machine Learning2019
- Combining multiple anatomical MRI measures improves Alzheimer's disease classificationHuman Brain Mapping, 2016
- A Case Study of Stacked Multi-view Learning in Dementia Research2011
- High‐Dimensional Cox Models: The Choice of Penalty as Part of the Model Building ProcessBiometrical Journal, 2010
- Measuring classifier performance: a coherent alternative to the area under the ROC curveMachine Learning, 2009
- The Elements of Statistical Learning2009
- An Introduction to Feature Extraction2008
- Time Series Analysis2002
- Stacked regressionsMachine Learning, 1996