Filling the gaps: Gaussian mixture models from noisy, truncated or incomplete samples
Authors:
Preprint
Abstract
We extend the common mixtures-of-Gaussians density estimation approach to account for a known sample incompleteness by simultaneous imputation from the current model. The method called GMMis generalizes existing Expectation-Maximization techniques for truncated data to arbitrary truncation geometries and probabilistic rejection. It can incorporate an uniform background distribution as well as independent multivariate normal measurement errors for each of the observed samples, and recovers an estimate of the error-free distribution from which both observed and unobserved samples are drawn. We compare GMMis to the standard Gaussian mixture model for simple test cases with different types of incompleteness, and apply it to observational data from the NASA Chandra X-ray telescope. The python code is capable of performing density estimation with millions of samples and thousands of model components and is released as an open-source package at https://github.com/pmelchior/pyGMMisKeywords
All Related Versions
This publication has 14 references indexed in Scilit:
- EM algorithms for multivariate Gaussian mixture models with truncated and censored dataComputational Statistics & Data Analysis, 2012
- EM algorithms for Gaussian mixtures with split-and-merge operationPattern Recognition, 2003
- Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture modelsComputational Statistics & Data Analysis, 2003
- Maximum Likelihood Estimation of Mixture Densities for Binned and Truncated Multivariate DataMachine Learning, 2002
- Missing data: Our view of the state of the art.Psychological Methods, 2002
- Split and Merge EM Algorithm for Improving Gaussian Mixture Density EstimatesJournal of Signal Processing Systems, 2000
- Linearly Combining Density Estimators via StackingMachine Learning, 1999
- Stacked regressionsMachine Learning, 1996
- Stacked generalizationNeural Networks, 1992
- Inference and missing dataBiometrika, 1976