RMoR-Aion: Robust Multioutput Regression by Simultaneously Alleviating Input and Output Noises
- 16 April 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 32 (3) , 1351-1364
Abstract
Multioutput regression, referring to simultaneously predicting multiple continuous output variables with a single model, has drawn increasing attention in the machine learning community due to its strong ability to capture the correlations among multioutput variables. The methodology of output space embedding, built upon the low-rank assumption, is now the mainstream for multioutput regression since it can effectively reduce the parameter numbers while achieving effective performance. The existing low-rank methods, however, are sensitive to the noises of both inputs and outputs, referring to the noise problem. In this article, we develop a novel multioutput regression method by simultaneously alleviating input and output noises, namely, robust multioutput regression by alleviating input and output noises (RMoR-Aion), where both the noises of the input and output are exploited by leveraging auxiliary matrices. Furthermore, we propose a prediction output manifold constraint with the correlation information regarding the output variables to further reduce the adversarial effects of the noise. Our empirical studies demonstrate the effectiveness of RMoR-Aion compared with the state-of-the-art baseline methods, and RMoR-Aion is more stable in the settings with artificial noise.Keywords
Funding Information
- National Natural Science Foundation of China (61602204, 61876071, 61806035, U1936217, 61672365)
- Fundamental Research Funds for the Central Universities of China (JZ2019HGPA0102)
- National Key Research and Development Program of China (2018YFB0804205)
- NSFC (61732008, 61725203)
This publication has 56 references indexed in Scilit:
- Real time prediction for converter gas tank levels based on multi-output least square support vector regressorControl Engineering Practice, 2012
- Network regression with predictive clustering treesData Mining and Knowledge Discovery, 2012
- Joint Modelling of Confounding Factors and Prominent Genetic Regulators Provides Increased Accuracy in Genetical Genomics StudiesPLOS Computational Biology, 2012
- A Bayesian Framework to Account for Complex Non-Genetic Factors in Gene Expression Levels Greatly Increases Power in eQTL StudiesPLOS Computational Biology, 2010
- Multi-task learning for cross-platform siRNA efficacy prediction: an in-silico studyBMC Bioinformatics, 2010
- Multi-output regression on the output manifoldPattern Recognition, 2009
- A multivariate regression approach to association analysis of a quantitative trait networkBioinformatics, 2009
- Capturing Heterogeneity in Gene Expression Studies by Surrogate Variable AnalysisPLOS Genetics, 2007
- On Learning Vector-Valued FunctionsNeural Computation, 2005
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970