Using Generative AI for Sequential Data Generation in Monte Carlo Simulation Studies
Authors:
- 30 December 2025
- journal article
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 51 (6) , 1337-1361
Abstract
Monte Carlo simulation studies are the de facto standard for assessing both classical and modern statistical methods. In traditional simulation studies, researchers have full discretion over data generation and often create simulated data with a high degree of smoothness and limited dependencies among variables. Under such conditions, the performance of statistical methods may not indicate their real-world performance. To address this issue, we propose a novel AI-based simulation framework that leverages generative AI (GenAI) to create realistic synthetic data and incorporate them into Monte Carlo simulation studies. In particular, we focus on simulation studies with sequential data (e.g., action sequences from process data) and demonstrate our approach by evaluating the predictive performance of an example statistical method. Our framework consists of five key steps: (a) pre-processing input data, (b) training GenAI models on input data, (c) assessing synthetic data quality, (d) conducting AI-based simulations, and (e) evaluating simulation results. We also perform robustness checks on both synthetic data quality and simulation outcomes by modifying specific steps of our approach. Overall, the proposed AI-based simulations outperform traditional simulations in generating realistic synthetic data and providing a more accurate evaluation of the real-world performance of statistical methods.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- MargCTGAN: A “Marginally” Better CTGAN for the Low Sample Regime2024
- Using Wasserstein Generative Adversarial Networks for the design of Monte Carlo simulationsJournal of Econometrics, 2024
- Latent Feature Extraction for Process Data via Multidimensional ScalingPsychometrika, 2020
- Mostly harmless simulations? Using Monte Carlo studies for estimator selectionJournal of Applied Econometrics, 2019
- Process Data in NAEP: Past, Present, and FutureJournal of Educational and Behavioral Statistics, 2018
- Data synthesis based on generative adversarial networksProceedings of the VLDB Endowment, 2018
- The Synthetic Data Vault2016
- Essentials of Monte Carlo Simulation2013
- Piaac: A New Strategy for Assessing Adult CompetenciesInternational Review of Education, 2008
- The Monte Carlo MethodJournal of the American Statistical Association, 1949