Robust semi-parametric mixtures of linear experts using the contaminated Gaussian distribution
Preprint
Abstract
Semi- and non-parametric mixture of regressions are a very useful flexible class of mixture of regressions in which some or all of the parameters are non-parametric functions of the covariates. These models are, however, based on the Gaussian assumption of the component error distributions. Thus, their estimation is sensitive to outliers and heavy-tailed error distributions. In this paper, we propose semi- and non-parametric contaminated Gaussian mixture of regressions to robustly estimate the parametric and/or non-parametric terms of the models in the presence of mild outliers. The virtue of using a contaminated Gaussian error distribution is that we can simultaneously perform model-based clustering of observations and model-based outlier detection. We propose two algorithms, an expectation-maximization (EM)-type algorithm and an expectation-conditional-maximization (ECM)-type algorithm, to perform maximum likelihood and local-likelihood kernel estimation of the parametric and non-parametric of the proposed models, respectively. The robustness of the proposed models is examined using an extensive simulation study. The practical utility of the proposed models is demonstrated using real data.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- A modified EM-type algorithm to estimate semi-parametric mixtures of non-parametric regressionsStatistics and Computing, 2024
- Mixture of linear experts model for censored data: A novel approach with scale-mixture of normal distributionsComputational Statistics & Data Analysis, 2021
- Semiparametric mixtures of regressions with single-index for model based clusteringAdvances in Data Analysis and Classification, 2020
- Mixtures of multivariate contaminated normal regression modelsStatistical Papers, 2017
- Semiparametric mixtures of nonparametric regressionsAnnals of the Institute of Statistical Mathematics, 2016
- Laplace mixture of linear expertsComputational Statistics & Data Analysis, 2016
- Robust mixture regression modeling based on scale mixtures of skew-normal distributionsTEST, 2015
- Robust mixture regression using the-distributionComputational Statistics & Data Analysis, 2014
- Robust mixture regression model fitting by Laplace distributionComputational Statistics & Data Analysis, 2014
- Mixtures of regressions with predictor-dependent mixing proportionsComputational Statistics & Data Analysis, 2010