Extracting data from graphs: A case‐study on animal research with implications for meta‐analyses
Open Access
- 8 February 2021
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 12 (6) , 701-710
Abstract
Systematic reviews with meta‐analyses are powerful tools that can answer research questions based on data from published studies. Ideally, all relevant data is directly available in the text or tables, but often it is only presented in graphs. In those cases, the data can be extracted from graphs, but this potentially introduces errors. Here, we investigate to what extent the extracted outcome and error values differ from the original data and if these differences could affect the results of a meta‐analysis. Six extractors extracted 36 outcome values and corresponding errors from 22 articles. Differences between extractors were compared using overall concordance correlation coefficients (OCCC), differences between the original and extracted data were compared using concordance correlation coefficients (CCC). To test the possible influence on meta‐analyses, random‐effects meta‐analyses on mean difference comparing original and extracted data were performed. The OCCCs and CCCs were high for both outcome values and errors, CCCs were >0.99 for the outcome and >0.92 for errors. The meta‐analyses showed that the overall effect on outcome was very small (median: 0.025, interquartile range: 0.016–0.046). Therefore, data extraction from graphs is a good method to harvest data if it is not provided in the text or tables, and the original authors cannot provide the data.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft (2591, BL 953/11‐1, TO 542/6‐1, JI 276/1‐1, LE 490 2356/5‐1, GA427/12‐1)
This publication has 37 references indexed in Scilit:
- Maternal separation is associated with strain‐specific responses to stress and epigenetic alterations to Nr3c1, Avp, and Nr4a1 in mouseBrain and Behavior, 2012
- Photoperiod Regulates Corticosterone Rhythms by Altered Adrenal Sensitivity via Melatonin-Independent Mechanisms in Fischer 344 Rats and C57BL/6J MicePLOS ONE, 2012
- Melanocortin-3 receptor regulates the normal fasting responseProceedings of the National Academy of Sciences, 2012
- Role of Corticotropin-Releasing Factor and Corticosterone in Behavioral Sensitization to EthanolThe Journal of Pharmacology and Experimental Therapeutics, 2012
- Metallothionein (MT) -I and MT-II Expression Are Induced and Cause Zinc Sequestration in the Liver after Brain InjuryPLOS ONE, 2012
- Steroid sulfatase-deficient mice exhibit endophenotypes relevant to Attention Deficit Hyperactivity DisorderPsychoneuroendocrinology, 2012
- Green tea polyphenols produce antidepressant-like effects in adult micePharmacological Research, 2012
- Effect Sizes Based on Means2009
- Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects ModelJournal of Educational and Behavioral Statistics, 2005
- A study of standardization of variables in cluster analysisJournal of Classification, 1988