Impact of Primary Health Care Data Quality on Infectious Disease Surveillance in Brazil: Case Study
Authors:
- Pilar Tavares Veras FlorentinoPFPilar Tavares Veras Florentino
- Juracy Bertoldo JuniorJJJuracy Bertoldo Junior
- George Caique Gouveia BarbosaGBGeorge Caique Gouveia Barbosa
- Thiago Cerqueira-SilvaTCThiago Cerqueira-Silva
- Vinicius de Araújo OliveiraVOVinicius de Araújo Oliveira
- Marcio Henrique de Oliveira GarciaMGMarcio Henrique de Oliveira Garcia
- Gerson Oliveira PennaGPGerson Oliveira Penna
- Viviane BoaventuraVBViviane Boaventura
- Pablo Ivan Pereira RamosPRPablo Ivan Pereira Ramos
- Manoel Barral-NettoMBManoel Barral-Netto
- Izabel MarcilioIMIzabel Marcilio
Open Access
- 21 February 2025
- journal article
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 11, e67050
Abstract
Background: The increase in emerging and re-emerging infectious disease outbreaks underscores the need for robust early warning systems (EWSs) to guide mitigation and response measures. Administrative health care databases provide valuable epidemiological insights without imposing additional burdens on health services. However, these datasets are primarily collected for operational use, making data quality assessment essential to ensure an accurate interpretation of epidemiological analysis. This study focuses on the development and implementation of a data quality index (DQI) for surveillance integrated into an EWS for influenza-like illness (ILI) outbreaks using Brazil’s a nationwide Primary Health Care (PHC) dataset. Objective: We aimed to evaluate the impact of data completeness and timeliness on the performance of an EWS for ILI outbreaks and establish optimal thresholds for a suitable DQI, thereby improving the accuracy of outbreak detection and supporting public health surveillance. Methods: A composite DQI was established to measure the completeness and timeliness of PHC data from the Brazilian National Information System on Primary Health Care. Completeness was defined as the proportion of weeks within an 8-week rolling window with any register of encounters. Timeliness was calculated as the interval between the date of encounter and its corresponding registry in the information system. The backfilled PHC dataset served as the gold standard to evaluate the impact of varying data quality levels from the weekly updated real-time PHC dataset on the EWS for ILI outbreaks across 5570 Brazilian municipalities from October 10, 2023, to March 10, 2024. Results: During the study period, the backfilled dataset recorded 198,335,762 ILI-related encounters, averaging 8,623,294 encounters per week. The EWS detected a median of 4 (IQR 2‐5) ILI outbreak warnings per municipality using the backfilled dataset. Using the real-time dataset, 12,538 (65%) warnings were concordant with the backfilled dataset. Our analysis revealed that 100% completeness yielded 76.7% concordant warnings, while 80% timeliness resulted in at least 50% concordant warnings. These thresholds were considered optimal for a suitable DQI. Restricting the analysis to municipalities with a suitable DQI increased concordant warnings to 80.4%. A median of 71% (IQR 54%-71.9%) of municipalities met the suitable DQI threshold weekly. Municipalities with ≥60% of weeks achieving a suitable DQI demonstrated the highest concordance between backfilled and real-time datasets, with those achieving ≥80% of weeks showing 82.3% concordance. Conclusions: Our findings highlight the critical role of data quality in improving the EWS’ performance based on PHC data for detecting ILI outbreaks. The proposed framework for real-time DQI monitoring is a practical approach and can be adapted to other surveillance systems, providing insights for similar implementations. We demonstrate that optimal completeness and timeliness of data significantly impact the EWS’ ability to detect ILI outbreaks. Continuous monitoring and improvement of data quality should remain a priority to strengthen the reliability and effectiveness of surveillance systems.Keywords
This publication has 17 references indexed in Scilit:
- Electronic health record data quality assessment and tools: a systematic reviewJournal of the American Medical Informatics Association, 2023
- Automating Electronic Health Record Data Quality AssessmentJournal of Medical Systems, 2023
- Effectiveness of early warning systems in the detection of infectious diseases outbreaks: a systematic reviewBMC Public Health, 2022
- Biases arising from linked administrative data for epidemiological research: a conceptual framework from registration to analysesEuropean Journal of Epidemiology, 2022
- A Review on the Application and Limitations of Administrative Health Care Data for the Study of Acute Kidney Injury Epidemiology and Outcomes in ChildrenFrontiers in Pediatrics, 2021
- Infectious disease in an era of global changeNature Reviews Microbiology, 2021
- Disease surveillance for the COVID-19 era: time for bold changesThe Lancet, 2021
- Defining & assessing the quality, usability, and utilization of immunization dataBMC Public Health, 2019
- Brazil's National Program for Improving Primary Care Access and Quality (PMAQ)Journal of Ambulatory Care Management, 2017
- The notion of data and its quality dimensionsInformation Processing & Management, 1994