Maximum Likelihood Estimation of Flexible Survival Densities with Importance Sampling
Authors:
- Mert KetenciMKMert Ketenci
- Shreyas BhaveSBShreyas Bhave
- Noémie ElhadadNENoémie Elhadad
- Adler PerotteAPAdler Perotte
Preprint
Abstract
Survival analysis is a widely-used technique for analyzing time-to-event data in the presence of censoring. In recent years, numerous survival analysis methods have emerged which scale to large datasets and relax traditional assumptions such as proportional hazards. These models, while being performant, are very sensitive to model hyperparameters including: (1) number of bins and bin size for discrete models and (2) number of cluster assignments for mixture-based models. Each of these choices requires extensive tuning by practitioners to achieve optimal performance. In addition, we demonstrate in empirical studies that: (1) optimal bin size may drastically differ based on the metric of interest (e.g., concordance vs brier score), and (2) mixture models may suffer from mode collapse and numerical instability. We propose a survival analysis approach which eliminates the need to tune hyperparameters such as mixture assignments and bin sizes, reducing the burden on practitioners. We show that the proposed approach matches or outperforms baselines on several real-world datasets.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Spatio-temporally smoothed deep survival neural networkJournal of Biomedical Informatics, 2022
- Deep Survival Machines: Fully Parametric Survival Regression and Representation Learning for Censored Data With Competing RisksIEEE Journal of Biomedical and Health Informatics, 2021
- Local Optima in Mixture ModelingMultivariate Behavioral Research, 2016
- Particle efficient importance samplingJournal of Econometrics, 2016
- On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival dataStatistics in Medicine, 2011
- Estimation methods for time‐dependent AUC models with survival dataCanadian Journal of Statistics, 2009
- A time‐dependent discrimination index for survival dataStatistics in Medicine, 2005
- Survival Analysis Using Auxiliary Variables Via Multiple Imputation, with Application to AIDS Clinical Trial DataBiometrics, 2002
- Comparison of the performance of neural network methods and Cox regression for censored survival dataComputational Statistics & Data Analysis, 2000
- Mixtures of proportional hazards regression modelsStatistics in Medicine, 1999