A Collaborative Learning Framework for Estimating Many Individualized Regression Models in a Heterogeneous Population
Open Access
- 7 December 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 67 (1) , 328-341
Abstract
Mixed-effect models (MEMs) have been found very useful for modeling complex dataset where many similar individualized regression models should be estimated. Like many statistical models, the success of these models builds on the assumption that a central tendency can effectively establish the population-level characteristics and covariates are sufficient to characterize the individual variation as derivation from the center. In many real-world problems, however, the dataset is collected from a rather heterogeneous population, where each individual has a distinct model. To fill in this gap, we propose a collaborative learning framework that provides a generic methodology for estimating a heterogeneous population of individualized regression models by exploiting the idea of “canonical models” and model regularization. By using a set of canonical models to represent the heterogeneous population characteristics, the canonical models span the modeling space for the individuals’ models, e.g., although each individual model is distinct, its model parameter vector can be represented by the parameter vectors of the canonical models. Theoretical analysis is also conducted to reveal a connection between the proposed method and the MEMs. Both simulation studies and applications on Alzheimer's disease and degradation modeling of turbofan engines demonstrate the efficacy of the proposed method.Keywords
Funding Information
- National Science Foundation (CMMI-1536398 CMMI-1435809)
This publication has 43 references indexed in Scilit:
- Data-Driven Fault Detection in Aircraft Engines With Noisy Sensor MeasurementsJournal of Engineering for Gas Turbines and Power, 2011
- Nonparametric Profile Monitoring by Mixed Effects ModelingTechnometrics, 2010
- Hypothetical model of dynamic biomarkers of the Alzheimer's pathological cascadeThe Lancet Neurology, 2010
- Relating one-year cognitive change in mild cognitive impairment to baseline MRI featuresNeuroImage, 2009
- The Alzheimer's disease neuroimaging initiative (ADNI): MRI methodsJournal of Magnetic Resonance Imaging, 2008
- Methods and Criteria for Model SelectionJournal of the American Statistical Association, 2004
- Approaches for reliability modeling of continuous-state devicesIEEE Transactions on Reliability, 1999
- A maximum likelihood methodology for clusterwise linear regressionJournal of Classification, 1988
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal DistributionsThe Annals of Mathematical Statistics, 1951