A Framework for Mediation Analysis with Massive Data
Authors:
Preprint
Abstract
During the past few years, mediation analysis has gained increasing popularity across various research fields. The primary objective of mediation analysis is to examine the direct impact of exposure on outcome, as well as the indirect effects that occur along the pathways from exposure to outcome. There has been a great number of articles that applied mediation analysis to data from hundreds or thousands of individuals. With the rapid development of technology, the volume of avaliable data increases exponentially, which brings new challenges to researchers. Directly conducting statistical analysis for large datasets is often computationally infeasible. Nonetheless, there is a paucity of findings regarding mediation analysis in the context of big data. In this paper, we propose utilizing subsampled double bootstrap and divide-and-conquer algorithms to conduct statistical mediation analysis on large-scale datasets. The proposed algorithms offer a significant enhancement in computational efficiency over traditional bootstrap confidence interval and Sobel test, while simultaneously ensuring desirable confidence interval coverage and power. We conducted extensive numerical simulations to evaluate the performance of our method. The practical applicability of our approach is demonstrated through two real-world data examples.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- Epigenome-Wide Association Studies2022
- Social Network Mediation Analysis: A Latent Space ApproachPsychometrika, 2021
- Mediation effect selection in high‐dimensional and compositional microbiome dataStatistics in Medicine, 2020
- The Correspondence Between Causal and Traditional Mediation Analysis: the Link Is the Mediator by Treatment InteractionPrevention Science, 2019
- Evaluating credit risk and loan performance in online Peer-to-Peer (P2P) lendingApplied Economics, 2014
- A Class of Distribution-Free Models for Longitudinal Mediation AnalysisPsychometrika, 2013
- Mediation analysis allowing for exposure–mediator interactions and causal interpretation: Theoretical assumptions and implementation with SAS and SPSS macros.Psychological Methods, 2013
- Estimation of causal mediation effects for a dichotomous outcome in multiple‐mediator models using the mediation formulaStatistics in Medicine, 2013
- Methods for Mediation Analysis with Missing DataPsychometrika, 2013
- Effect size measures for mediation models: Quantitative strategies for communicating indirect effects.Psychological Methods, 2011