Estimating treatment effects under untestable assumptions with nonignorable missing data
Authors:
- 14 February 2020
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 39 (11) , 1658-1674
Abstract
Nonignorable missing data poses key challenges for estimating treatment effects because the substantive model may not be identifiable without imposing further assumptions. For example, the Heckman selection model has been widely used for handling nonignorable missing data but requires the study to make correct assumptions, both about the joint distribution of the missingness and outcome and that there is a valid exclusion restriction. Recent studies have revisited how alternative selection model approaches, for example estimated by multiple imputation (MI) and maximum likelihood, relate to Heckman‐type approaches in addressing the first hurdle. However, the extent to which these different selection models rely on the exclusion restriction assumption with nonignorable missing data is unclear. Motivated by an interventional study (REFLUX) with nonignorable missing outcome data in half of the sample, this article critically examines the role of the exclusion restriction in Heckman, MI, and full‐likelihood selection models when addressing nonignorability. We explore the implications of the different methodological choices concerning the exclusion restriction for relative bias and root‐mean‐squared error in estimating treatment effects. We find that the relative performance of the methods differs in practically important ways according to the relevance and strength of the exclusion restriction. The full‐likelihood approach is less sensitive to alternative assumptions about the exclusion restriction than Heckman‐type models and appears an appropriate method for handling nonignorable missing data. We illustrate the implications of method choice for inference in the REFLUX study, which evaluates the effect of laparoscopic surgery on long‐term quality of life for patients with gastro‐oseophageal reflux disease.Keywords
This publication has 30 references indexed in Scilit:
- Development of a practical approach to expert elicitation for randomised controlled trials with missing health outcomes: Application to the IMPROVE trialClinical Trials, 2017
- A multiple imputation approach for MNAR mechanisms compatible with Heckman's modelStatistics in Medicine, 2016
- Robust Inference in Sample Selection ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2015
- A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled TrialsPharmacoEconomics, 2014
- Identification of causal effects in the presence of nonignorable missing outcome valuesBiometrics, 2014
- Missing Data in Longitudinal Studies2008
- Nonparametric Estimation of Sample Selection ModelsReview of Economic Studies, 2003
- The Heckman Correction for Sample Selection and Its CritiqueJournal of Economic Surveys, 2000
- Estimating Models with Sample Selection Bias: A SurveyThe Journal of Human Resources, 1998
- Sample Selection Bias as a Specification ErrorEconometrica, 1979