Fitting mixtures of linear regressions
- 1 February 2010
- journal article
- research article
- Published by Taylor & Francis in Journal of Statistical Computation and Simulation
- Vol. 80 (2) , 201-225
Abstract
In most applications, the parameters of a mixture of linear regression models are estimated by maximum likelihood using the expectation maximization (EM) algorithm. In this article, we propose the comparison of three algorithms to compute maximum likelihood estimates of the parameters of these models: the EM algorithm, the classification EM algorithm and the stochastic EM algorithm. The comparison of the three procedures was done through a simulation study of the performance (computational effort, statistical properties of estimators and goodness of fit) of these approaches on simulated data sets. Simulation results show that the choice of the approach depends essentially on the configuration of the true regression lines and the initialization of the algorithms.Keywords
This publication has 17 references indexed in Scilit:
- Hypothesis Testing in Mixture Regression ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2003
- Computer-Assisted Analysis of Mixtures and ApplicationsTechnometrics, 2000
- Stochastic versions of the em algorithm: an experimental study in the mixture caseJournal of Statistical Computation and Simulation, 1996
- Comparison of the mixture and the classification maximum likelihood in cluster analysisJournal of Statistical Computation and Simulation, 1993
- Switching regression models and fuzzy clusteringIEEE Transactions on Fuzzy Systems, 1993
- A classification EM algorithm for clustering and two stochastic versionsComputational Statistics & Data Analysis, 1992
- FITTING FINITE MIXTURE MODELS IN A REGRESSION CONTEXTAustralian Journal of Statistics, 1992
- Mixtures of linear regressionsComputational Statistics & Data Analysis, 1989
- Classification and Mixture Approaches to Clustering via Maximum LikelihoodJournal of the Royal Statistical Society Series C: Applied Statistics, 1989
- Estimating Mixtures of Normal Distributions and Switching RegressionsJournal of the American Statistical Association, 1978