MSE FINDR: A Shiny R Application to Estimate Mean Square Error Using Treatment Means and Post Hoc Test Results
- 1 July 2024
- journal article
- research article
- Published by Scientific Societies in Plant Disease
- Vol. 108 (7) , 1937-1945
Abstract
Research synthesis methods such as meta-analysis rely primarily on appropriate summary statistics (i.e., means and variance) of a response of interest for implementation to draw general conclusions from a body of research. A commonly encountered problem arises when a measure of variability of a response across a study is not explicitly provided in the summary statistics of primary studies. Typically, these otherwise credible studies are omitted in research synthesis, leading to potential small-study effects and loss of statistical power. We present MSE FINDR, a user-friendly Shiny R application for estimating the mean square error (i.e., within-study residual variance, [ ]) for continuous outcomes from analysis of variance (ANOVA)-type studies, with specific experimental designs and treatment structures (Latin square, completely randomized, randomized complete block, two-way factorial, and split-plot designs). MSE FINDR accomplishes this by using commonly reported information on treatment means, significance level (α), number of replicates, and post hoc mean separation tests (Fisher’s least significant difference [LSD], Tukey’s honest significant difference [HSD], Bonferroni, Šidák, and Scheffé). Users upload a CSV file containing the relevant information reported in the study and specify the experimental design and post hoc test that was applied in the analysis of the underlying data. MSE FINDR then proceeds to recover [ ] based on user-provided study information. The recovered within-study variance can be downloaded and exported as a CSV file. Simulations of trials with a variable number of treatments and treatment effects showed that the MSE FINDR-recovered [ ] was an accurate predictor of the actual ANOVA [ ] for one-way experimental designs when summary statistics (i.e., means, variance, and post hoc results) were available for the single factor. Similarly, [ ] recovered by the application accurately predicted the actual [ ] for two-way experimental designs when summary statistics were available for both factors and the sub-plot factor in split-plot designs, irrespective of the post hoc mean separation test. The MSE FINDR Shiny application, documentation, and an accompanying tutorial are hosted at https://garnica.shinyapps.io/MSE_FindR/ and https://github.com/vcgarnica/MSE_FindR/ . With this tool, researchers can now easily estimate the within-study variance absent in published reports that nonetheless provide appropriate summary statistics, thus enabling the inclusion of such studies that would have otherwise been excluded in meta-analyses involving estimates of effect sizes based on a continuous response.Keywords
Funding Information
- USDA-AFRI (2020-67013-31920)
- North Carolina Agricultural Experiment Station (NC02950)
- USDA National Institute of Food and Federal Appropriations (PEN04836)
This publication has 23 references indexed in Scilit:
- Meta-analysis protocol on the effects of cover crops on pool specific soil organic carbonMethodsX, 2023
- Openness and Computational Reproducibility in Plant Pathology: Where We Stand and a Way ForwardPhytopathology®, 2023
- Does the application of biogas slurry reduce soil N2O emissions and increase crop yield?–A systematic reviewJournal of Environmental Management, 2023
- EX-TRACT: An excel tool for the estimation of standard deviations from published articlesEnvironmental Modelling & Software, 2022
- Meta-analysis and the science of research synthesisNature, 2018
- Meta‐analysis with missing study‐level sample variance dataStatistics in Medicine, 2016
- Multiple Treatment Meta-Analysis of Products Evaluated for Control of Fire Blight in the Eastern United StatesPhytopathology®, 2011
- Meta-Analysis for Evidence Synthesis in Plant Pathology: An OverviewPhytopathology®, 2011
- Imputing variance estimates do not alter the conclusions of a meta-analysis with continuous outcomes: a case study of changes in renal function after living kidney donationJournal of Clinical Epidemiology, 2007
- Imputing missing standard deviations in meta-analyses can provide accurate resultsJournal of Clinical Epidemiology, 2006