Interrupted Time Series Design and Analyses in Health Policy Assessment
Preprint
Abstract
Interrupted time series design is a quasi-experimental study design commonly used to evaluate the impact of a particular intervention (e.g., a health policy implementation) on a specific outcome. Two of the most often recommended analytical approaches to interrupted time series analysis are autoregressive integrated moving average (ARIMA) and Generalized Additive Models (GAM). We conducted simulation tests to determine the performance differences between ARIMA and GAM methodology across different policy effect sizes, with or without seasonality, and with or without misspecification of policy variables. We found that ARIMA exhibited more consistent results under certain conditions, such as with different policy effect sizes, with or without seasonality, while GAM were more robust when the model was misspecified. Given these findings, the variation between the models underscores the need for careful model selection and validation in health policy studies.Keywords
This publication has 16 references indexed in Scilit:
- Restricting alcohol marketing to reduce alcohol consumption: A systematic review of the empirical evidence for one of the ‘best buys’Addiction, 2024
- Design characteristics and statistical methods used in interrupted time series studies evaluating public health interventions: a reviewJournal of Clinical Epidemiology, 2020
- Understanding and using time series analyses in addiction researchAddiction, 2019
- The use of controls in interrupted time series studies of public health interventionsInternational Journal of Epidemiology, 2018
- Smoothing Parameter and Model Selection for General Smooth ModelsJournal of the American Statistical Association, 2016
- The Excess Winter Deaths MeasureEpidemiology, 2016
- A comparative simulation study of AR(1) estimators in short time seriesQuality & Quantity, 2015
- Interrupted time series analysis in drug utilization research is increasing: systematic review and recommendationsJournal of Clinical Epidemiology, 2015
- The temporal relationship between per capita alcohol consumption and harm: A systematic review of time lag specifications in aggregate time series analysesDrug and Alcohol Dependence, 2012
- INTERRUPTED TIME SERIES DESIGNS IN HEALTH TECHNOLOGY ASSESSMENT: LESSONS FROM TWO SYSTEMATIC REVIEWS OF BEHAVIOR CHANGE STRATEGIESInternational Journal of Technology Assessment in Health Care, 2003