A novel approach to evaluate data integrity: evidence from COVID-19 in China
Open Access
- 15 March 2024
- journal article
- research article
- Published by Revista Brasileira de Biometria in Brazilian Journal of Biometrics
- Vol. 42 (1) , 78-87
Abstract
The COVID-19 pandemic has generated an unprecedented amount of epidemiological data. Yet, concerns regarding the validity and reliability of the information reported by health surveillance systems have emerged worldwide. In this paper, we develop a novel approach to evaluating data integrity by combining the Newcomb-Benford Law with outlier methods. We demonstrate the advantages of our framework using a case study from China. To ensure more robust findings, we employ multiple diagnostic procedures, including three conformity estimates, four goodness-of-fit tests, and two distance measures (Cook and Mahalanobis). To promote transparency, we have made all computational scripts publicly available. Our findings indicates a significant deviation in the distribution of new deaths from the theoretical expectations of Benford's Law. Importantly, these results remain accurate even when considering alternative model specifications and conducting various statistical tests. Furthermore, the procedures developed here are easily applicable in other areas of knowledge and can be scaled to assess data quality in both the public and private sectors.Keywords
This publication has 32 references indexed in Scilit:
- Does ‘Data fudging’ explain the autocratic advantage? Evidence from the gap between Official Covid-19 mortality and excess mortalitySSM - Population Health, 2022
- Political regime, data transparency, and COVID-19 death casesSSM - Population Health, 2021
- Detecting academic fraud using Benford law: The case of Professor James HuntonResearch Policy, 2020
- Mathematical modeling of the spread of the coronavirus disease 2019 (COVID-19) taking into account the undetected infections. The case of ChinaCommunications in Nonlinear Science and Numerical Simulation, 2020
- Estimating the instant case fatality rate of COVID-19 in ChinaInternational Journal of Infectious Diseases, 2020
- Election Forensics: Quantitative methods for electoral fraud detectionForensic Science International, 2019
- Benford's law and the limits of digit analysisInternational Journal of Accounting Information Systems, 2018
- The Benford law behavior of the religious activity dataPhysica A: Statistical Mechanics and its Applications, 2014
- Benford's law in the natural sciencesGeophysical Research Letters, 2010
- Empirical mantissa distributions of pulsarsAstroparticle Physics, 2010