Single paper meta‐analysis is unavoidable
Open Access
- 10 September 2025
- journal article
- Published by Wiley in Journal of Consumer Psychology
- Vol. 35 (4) , 663-685
Abstract
We advocate that the multiple studies of a common phenomenon that are featured in a typical behavioral research paper be jointly analyzed to provide a statistical summary of the set of studies as a whole. Indeed, we view such single paper meta‐analysis as unavoidable in typical behavioral research papers because (i) such papers feature multiple studies of a common phenomenon, (ii) such papers contain summaries of those studies, and (iii) statistical summaries of studies (i.e., meta‐analyses) are superior to non‐statistical summaries of them. Nonetheless, the current dominant practice is for such papers to feature separate statistical analyses of the data from each of the studies but to contain a non‐statistical summary of the multiple studies rather than a statistical summary. We believe that this is regrettable and therefore aim to rectify matters. Consequently, we review some considerations about meta‐analysis and statistical analysis more broadly; compare single paper meta‐analysis to traditional meta‐analysis and illustrate its benefits via a case study; discuss and dismiss concern about single paper meta‐analysis; and discuss single paper meta‐analysis and the review process.Keywords
This publication has 98 references indexed in Scilit:
- Commentaries on “Beyond statistical significance: Five principles for the new era of data analysis and reporting”Journal of Consumer Psychology, 2023
- Beyond statistical significance: Five principles for the new era of data analysis and reportingJournal of Consumer Psychology, 2023
- Meta‐analysis of Studies with Multiple Contrasts and Differences in Measurement ScalesJournal of Consumer Psychology, 2021
- Pre‐registration is a Game Changer. But, Like Random Assignment, it is Neither Necessary Nor Sufficient for Credible ScienceJournal of Consumer Psychology, 2020
- Advances in Meta-Analysis2012
- Introduction to Meta‐Analysis2009
- Selection Method Approaches2005
- Publication Bias in Meta‐Analysis2005
- The role ofP‐values in analysing trial resultsStatistics in Medicine, 1993
- Theoretical Statistics1974