Sensitivity Analysis for Multiple Comparisons in Matched Observational Studies through Quadratically Constrained Linear Programming
Preprint
Abstract
A sensitivity analysis in an observational study assesses the robustness of significant findings to unmeasured confounding. While sensitivity analyses in matched observational studies have been well addressed when there is a single outcome variable, accounting for multiple comparisons through the existing methods yields overly conservative results when there are multiple outcome variables of interest. This stems from the fact that unmeasured confounding cannot affect the probability of assignment to treatment differently depending on the outcome being analyzed. Existing methods allow this to occur by combining the results of individual sensitivity analyses to assess whether at least one hypothesis is significant, which in turn results in an overly pessimistic assessment of a study's sensitivity to unobserved biases. By solving a quadratically constrained linear program, we are able to perform a sensitivity analysis while enforcing that unmeasured confounding must have the same impact on the treatment assignment probabilities across outcomes for each individual in the study. We show that this allows for uniform improvements in the power of a sensitivity analysis not only for testing the overall null of no effect, but also for null hypotheses on \textit{specific} outcome variables while strongly controlling the familywise error rate. We illustrate our method through an observational study on the effect of smoking on naphthalene exposure.Keywords
All Related Versions
This publication has 40 references indexed in Scilit:
- WeightedM-statistics With Superior Design Sensitivity in Matched Observational Studies With Multiple ControlsJournal of the American Statistical Association, 2014
- An Introduction to Sensitivity Analysis for Unobserved Confounding in Nonexperimental Prevention ResearchPrevention Science, 2013
- Using full matching to estimate causal effects in nonexperimental studies: Examining the relationship between adolescent marijuana use and adult outcomes.Developmental Psychology, 2008
- Hierarchical testing of variable importanceBiometrika, 2008
- Causal conclusions are most sensitive to unobserved binary covariatesStatistics in Medicine, 2005
- Design sensitivity in observational studiesBiometrika, 2004
- A Study for the Proper Application of Urinary Naphthols, New Biomarkers for Airborne Polycyclic Aromatic HydrocarbonsArchives of Environmental Contamination and Toxicology, 1999
- Hemolysis from Exposure to Naphthalene MothballsNew England Journal of Medicine, 1991
- Estimating causal effects of treatments in randomized and nonrandomized studies.Journal of Educational Psychology, 1974
- Programming with linear fractional functionalsNaval Research Logistics Quarterly, 1962