Combining planned and discovered comparisons in observational studies
Open Access
- 26 September 2018
- journal article
- research article
- Published by Oxford University Press (OUP) in Biostatistics
- Vol. 21 (3) , 384-399
Abstract
In observational studies of treatment effects, it is common to have several outcomes, perhaps of uncertain quality and relevance, each purporting to measure the effect of the treatment. A single planned combination of several outcomes may increase both power and insensitivity to unmeasured bias when the plan is wisely chosen, but it may miss opportunities in other cases. A method is proposed that uses one planned combination with only a mild correction for multiple testing and exhaustive consideration of all possible combinations fully correcting for multiple testing. The method works with the joint distribution of $$\kappa^{T}\left( \mathbf{T}-\boldsymbol{\mu}\right) /\sqrt {\boldsymbol{\kappa}^{T}\boldsymbol{\Sigma\boldsymbol{\kappa}}}$$ and $$max_{\boldsymbol{\lambda}\neq\mathbf{0}}$$ $$\,\lambda^{T}\left( \mathbf{T} -\boldsymbol{\mu}\right) /$$ $$\sqrt{\boldsymbol{\lambda}^{T}\boldsymbol{\Sigma \lambda}}$$ where $$\kappa$$ is chosen a priori and the test statistic $$\mathbf{T}$$ is asymptotically $$N_{L}\left( \boldsymbol{\mu},\boldsymbol{\Sigma}\right) $$. The correction for multiple testing has a smaller effect on the power of $$\kappa^{T}\left( \mathbf{T}-\boldsymbol{\mu }\right) /\sqrt{\boldsymbol{\kappa}^{T}\boldsymbol{\Sigma\boldsymbol{\kappa} }}$$ than does switching to a two-tailed test, even though the opposite tail does receive consideration when $$\lambda=-\kappa$$. In the application, there are three measures of cognitive decline, and the a priori comparison $$\kappa$$ is their first principal component, computed without reference to treatment assignments. The method is implemented in an R package sensitivitymult.
Keywords
This publication has 26 references indexed in Scilit:
- Bayesian sensitivity analysis for causal effects from $2\times2$ tables in the presence of unmeasured confounding with application to presidential campaign visitsThe Annals of Applied Statistics, 2017
- Randomization Inference and Sensitivity Analysis for Composite Null Hypotheses With Binary Outcomes in Matched Observational StudiesJournal of the American Statistical Association, 2017
- Sensitivity Analysis for Multiple Comparisons in Matched Observational Studies Through Quadratically Constrained Linear ProgrammingJournal of the American Statistical Association, 2016
- How strong is strong enough? Strengthening instruments through matching and weak instrument testsThe Annals of Applied Statistics, 2016
- Instrumental variable methods for causal inferenceStatistics in Medicine, 2014
- Split Samples and Design Sensitivity in Observational StudiesJournal of the American Statistical Association, 2009
- Pharmacologic Agents Associated with a Preventive Effect on Alzheimer's Disease: A Review of the Epidemiologic EvidenceEpidemiologic Reviews, 2002
- Asymptotic Separability in Sensitivity AnalysisJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- A case‐control study of Alzheimer's disease in ChinaNeurology, 1992
- A Verbal Memory Test With High Predictive Accuracy for Dementia of the Alzheimer TypeArchives of Neurology, 1989