Introduction to statistical simulations in health research
Open Access
Abstract
In health research, statistical methods are frequently used to address a wide variety of research questions. For almost every analytical challenge, different methods are available. But how do we choose between different methods and how do we judge whether the chosen method is appropriate for our specific study? Like in any science, in statistics, experiments can be run to find out which methods should be used under which circumstances. The main objective of this paper is to demonstrate that simulation studies, that is, experiments investigating synthetic data with known properties, are an invaluable tool for addressing these questions. We aim to provide a first introduction to simulation studies for data analysts or, more generally, for researchers involved at different levels in the analyses of health data, who (1) may rely on simulation studies published in statistical literature to choose their statistical methods and who, thus, need to understand the criteria of assessing the validity and relevance of simulation results and their interpretation; and/or (2) need to understand the basic principles of designing statistical simulations in order to efficiently collaborate with more experienced colleagues or start learning to conduct their own simulations. We illustrate the implementation of a simulation study and the interpretation of its results through a simple example inspired by recent literature, which is completely reproducible using the R-script available from online supplemental file 1.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (BO3139/4-3)
- Deutsche Forschungsgemeinschaft (SA580/10-1)
- Canadian Institutes of Health Research (PJT-148946)
- Natural Sciences and Engineering Research Council of Canada (228203)
This publication has 24 references indexed in Scilit:
- Subsampling Versus Bootstrapping in Resampling-Based Model Selection for Multivariable RegressionBiometrics, 2015
- A comparison of three clustering methods for finding subgroups in MRI, SMS or clinical data: SPSS TwoStep Cluster analysis, Latent Gold and SNOBBMC Medical Research Methodology, 2014
- STRengthening Analytical Thinking for Observational Studies: the STRATOS initiativeStatistics in Medicine, 2014
- Biomedical research: increasing value, reducing wasteThe Lancet, 2014
- Evidence of subgroup‐specific treatment effect in the absence of an overall effect: is there really a contradiction?Pharmacoepidemiology and Drug Safety, 2013
- To test or not to test: Preliminary assessment of normality when comparing two independent samplesBMC Medical Research Methodology, 2012
- To Explain or to Predict?Statistical Science, 2010
- A simulation study to compare robust clustering methods based on mixturesAdvances in Data Analysis and Classification, 2010
- Decorrelation of the True and Estimated Classifier Errors in High-Dimensional SettingsEURASIP Journal on Bioinformatics and Systems Biology, 2007
- The design of simulation studies in medical statisticsStatistics in Medicine, 2006