Multiverse analysis for dynamic network models: Investigating the influence of plausible alternative modeling choices
Open Access
- 30 June 2025
- journal article
- Published by Leibniz Institute for Psychology (ZPID) in Methodology
- Vol. 21 (2) , 123-143
Abstract
Specifying complex time series models typically allows for a wide range of plausible analysis strategies. However, researchers typically perform and report only a single, preferred analysis while ignoring alternatives that could yield different conclusions. As a remedy, we propose multiverse analysis to investigate the robustness of dynamic network analysis to arbitrary modeling choices. We focus on group iterative multiple model estimation (GIMME), a highly data-driven approach, and re-analyze two datasets (combined n = 199). We vary seven modeling parameters, resulting in 3,888 fitted models. Group-level and to a lesser extent subgroup-level results were mostly stable. Individual-level estimates were more heterogeneous, with some decisions strongly influencing results and conclusions. The robustness of GIMME to alternative modeling choices depends on the level of analysis. For some individuals, results may differ strongly even when changing the algorithm only slightly. Multiverse analysis is a valuable tool for checking the robustness of results from time series models.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Patterns of emotion-network dynamics are orthogonal to mood disorder status: An experience sampling investigation.Emotion, 2024
- Psychopathological networks: Theory, methods and practiceBehaviour Research and Therapy, 2022
- Supplemental Material for Dynamic Fit Index Cutoffs for Confirmatory Factor Analysis ModelsPsychological Methods, 2021
- The current status of temporal network analysis for clinical science: Considerations as the paradigm shifts?Journal of Clinical Psychology, 2020
- Assessing the robustness of cluster solutions obtained from sparse count matrices.Psychological Methods, 2019
- What do centrality measures measure in psychological networks?Journal of Abnormal Psychology, 2019
- Uncovering general, shared, and unique temporal patterns in ambulatory assessment data.Psychological Methods, 2019
- Group search algorithm recovers effective connectivity maps for individuals in homogeneous and heterogeneous samplesNeuroImage, 2012
- Comparing clusterings—an information based distanceJournal of Multivariate Analysis, 2007
- Comparing partitionsJournal of Classification, 1985